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THE INTEGRATED PERIODOGRAM OF A DEPENDENT EXTREMAL 

EVENT SEQUENCE 

THOMAS MIKOSCH AND YUWEI ZHAO 


Abstract. We investigate the asymptotic properties of the integrated periodogram calculated 
from a sequence of indicator functions of dependent extremal events. An event in Euclidean space is 
extreme if it occurs far away from the origin. We use a regular variation condition on the underlying 
stationary sequence to make these notions precise. Our main result is a functional central limit 
theorem for the integrated periodogram of the indicator functions of dependent extremal events. 
The limiting process is a continuous Gaussian process whose covariance structure is in general 
unfamiliar, but in the iid case a Brownian bridge appears. In the general case, we propose a 
stationary bootstrap procedure for approximating the distribution of the limiting process. The 
developed theory can be used to construct classical goodness-of-fit tests such as the Grenander- 
Rosenblatt and Cramer-von Mises tests which are based only on the extremes in the sample. We 
apply the test statistics to simulated and real-life data. 


1. Introduction 


1.1. Regularly varying sequences. We consider a strictly stationary Revalued sequence (X t ) 
for some d > 1 with a generic element X and assume that its finite-dimensional distributions are 
regularly varying. This means that for every h > 1 , there exists a non-null Radon measure fih on 
the Borel cr-field B ^ of R^ = R d,t \{0}, R = {—oo, oo}, such that 


( 1 . 1 ) 


P{x~ 1 (X ll ...,X h ) g •) 

P(\X\ >x) 


V / \ 

Vhv) , 


where A denotes vague convergence in B g^; cf. Resnick [2f>][26], Kallenberg [20] . The limiting 
measure g,h necessarily has the property t > 0. for some a > 0, the index of 

regular variation. In what follows, we assume that a > 0. Relation m is equivalent to the 
sequential definition 

(1.2) nP(a~ 1 (X 1 ,... ,X h ) £ •) 4 , n oo , 


where ( a n ) is chosen such that P{\X\ > a n ) ~ n -1 as n —> oo. We will say that the sequence ( X t ) 
and any of the vectors (Xi,..., Xh), h > 1, are regularly varying with index a. 

Examples of regularly varying strictly stationary sequences are linear and stochastic volatility 
processes with iid regularly varying noise, GARCH processes, infinite variance stable processes and 
max-stable processes with Frechet marginals. These examples are discussed e.g. in Davis et al. 
ci main], Mikosch and Zhao m ■ 
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and the Forschungsinstitut fur Mathematik of ETH Zurich. Both authors take pleasure to thank their hosts for 
financial support and a constructive scientific atmosphere. The research of Thomas Mikosch is partly supported by 
the Danish Research Council Grant DFF-4002-000435. 
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1.2. The extremogram. Consider a /xi-continuity Borel set Dq = A C K 0 bounded away from 

zero and such that p\(A) > 0 . Then the sets D^ = A x R d ^ 1 x A are bounded away from zero as 
well and are continuity sets with respect to the corresponding limiting measures p,h+ i, h > 1 . We 
conclude from US) that the limits 

(1.3) ^ A (h) = \\m nP(a~ 1 X 0 & A.a^Xn & A) = p h+ 1 (D h ), h> 0, 

n—>oo 

exist. For t £ Z, it is not difficult to see that 

nC0V ( / {a^ 1 A t eA}> / {a^ 1 A: t+h eA}) ~ nEI {a^ 1 Xt£A,an 1 X t+h eA} 

= n P(a n 1 A"o € A , a ra 1 AA £ A) 

—> "f A (h), n —> oo . 

Hence 7 A constitutes the covariance function of a stationary process. We refer to 7 A as the ex¬ 
tremogram relative to the set A. We will also consider the standardized extremogram given as the 
limiting sequence 

PA (h) = lim P(a~ x X h £ A | a-'Xo £ A) = ^ h+1 ^ , h > 0 . 

n^foo Pi{Uq) 

The quantities p A (h) have an intuitive interpretation as limiting conditional probabilities. Moreover, 
p A is the autocorrelation function of a stationary process. The quantities p A {h) are generalizations 
of the upper tail dependence coefficient of a two-dimensional vector (Yj, Y 2 ) with identical marginals 
given as the limit lim^oo P(Y 2 > x | Y\ > x). 

The extremogram was introduced in Davis and Mikosch [ 7 ] as a measure of serial extremal 
dependence in a strictly stationary sequence. There and in Davis et al. mm various aspects of 
the estimation of the extremogram were discussed, including asymptotic theory and the use of the 
stationary bootstrap for the construction of confidence bands. 

1.3. The sample extremogram. Natural estimators of the extremograms 7 a and p A are given 
by their respective sample analogs 

7 a (ft) = — F IJt+h and p A (h) = , h > 0 . 

n ^ 7 a( 0 ) 

Here m = m n is any integer sequence satisfying the conditions m n —> 00 and m n /n = o(l) and 

h = I {a^ 1 x t eA} > It = It - Po , and p 0 = EI t = P(a“ 1 X £ A),t€Z. 

It is shown in Davis and Mikosch [ 7 ] that the conditions m n —> 00 and m n /n = o(l) are needed 
for the validity of the asymptotic properties E^ A (h) -A 7 A (h) and var(7 A {h)) —> 0 as n —> 00. 
Moreover, under a mixing condition, the finite-dimensional distributions of 7(4 and p A satisfy a 
central limit theorem with normalization (n/m) 1 / 2 ; cf. Lemma [ 4 ] below. 

1.4. Spectral density and periodogram. Since 7 a and p A are the autocovariance and auto¬ 
correlation functions of a stationary process, respectively, it is possible to enter the corresponding 
frequency domain. If 7 a is square summable one can define the spectral densities 

h A (X) = ^ 2 "/ A (h)e~ lhx and /a(A) = y ^p A (h)e~ lhx , A € [0,7r] = n. 
ft,ez he z 

A natural estimator of the spectral density is the periodogram. Since the sample autocovariances 
7 a (h) are derived from the triangular array of the stationary sequences (It), an analog of the classical 




THE INTEGRATED PERIODOGRAM OF A DEPENDENT EXTREMAL EVENT SEQUENCE 


3 


periodogram for Ha is given by 


In,A (A) 


m 

n 




—i t x 


n —1 

7a(0) 4- 2 ^2 7 A(h) cos(ftA), A G II, 

/i=i 


and the periodogram for the standardized spectral density /a is obtained as the scaled periodogram 
J„ j a/7a( 0). Mikosch and Zhao |21| showed under mixing conditions that the extremal periodogram 
ordinates I n ,A(X) share various of the classical properties of the periodogram ordinates for a sta¬ 
tionary sequence (cf. Brockwell and Davis [2j): consistency in the mean, convergence in distribution 
to independent exponential random variables with expectation Iia (A,) at distinct fixed frequencies 
A j £ (0,7r) and at distinct Fourier frequencies u) n (j ) = 2nj/n £ (0,7r) provided these frequencies 
converge to a limit A j £ (0, n) as n —> oo. The latter property ensures that weighted versions of the 
periodogram I U} a at fixed frequencies A £ (0,7r) converge in mean square to Ha{ A). 

For practical purposes, one will mostly work with the periodogram at the Fourier frequencies 
u] n (j) £ (0,7r). Then 


n 2 

Iu,aM)) = - , 

i.e., centering of the indicator functions It is not needed. However, for proving asymptotic theory 
it will be convenient to work with the extremal periodogram I n ^A based on the centered quantities 

It, t = 1 ,... ,n. 

1.5. The integrated periodogram. The integrated periodogram of a stationary sequence has a 
long history in time series analysis, starting with classical work of Grenander and Rosenblatt M, 
and was extensively used in the monographs Hannan m , Priestley [23] , Brockwell and Davis [3], to 
name a few references. Dahlhaus [4] discovered a close relationship of the integrated periodogram, 
considered as a process indexed by functions, and empirical process theory. Under entropy condi¬ 
tions, he proved uniform convergence results over suitable classes of index functions; see also the 
survey paper Dahlhaus and Polonik [5] . These papers gave some general theoretical background for 
various periodogram based techniques such as Whittle estimation of the parameters of a FARIMA 
process and goodness of fit tests for linear processes as mentioned in Grenander and Rosenblatt [14] 
and Priestley [24] . 

In this paper, we will consider the integrated periodogram 


(1.4) 

and its standardized version 


P n —1 

Jn,A(g) = / 4,yt(A)g(A) dX = c 0 (ff) 7 a(0) + 2 c h (g)l A (h) 

J n 


h =1 


n —1 


= ^~77a j I n ,AWg(X)dX = co{g) + 2^2c h (g)p A {h), 

7a(°) J n 


where g is non-negative and square integrable with respect to Lebesgue measure on n (we write 
g £ L 2 + (U)) with corresponding Fourier coefficients 


Ch(g) 


cos(hA) g( A) dX , 


h £ Z. 
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We will understand J n ,A{g) and J° A (g) as natural estimators of 


(1.5) 


J A (g)= [ h A (X)g(X)dX 
J n 

J° A (g) = [ f A (X)g(X)dX 
J n 


co(ff) 7 a(0) + 2 ^2 c h ( g ) 7 A ( h ), 
h= 1 
oo 

c 0 (g) + 2^2 c h (g) p A ( h ), 

h=l 


respectively. The latter identities hold if '}2hLo r Y A (h) < oo, a condition we assume throughout this 
paper; see also Remark [5] below. 

The main results of this paper (see Section [3j) are functional central limit theorems for the 
integrated periodogram J n ^ A with g = hl [ 0 ..] for a sufficiently smooth function h on II. The limit 
processes are Gaussian whose covariance structure strongly depends on the limit measures (gh)- 
The rate of convergence in these results is typically slower than yjn. However, in the case of an iid 
sequence, the limiting process is a Brownian bridge and the convergence rates are much faster than 
in the case of a dependent sequence. These results differ from classical theory for the periodogram 
of a stationary sequence ( X t ) (see e.g. Dahlhaus [3], Kliippelberg and Mikosch [Hi]), where the 
limiting process is completely determined by the covariance structure of (X t ). The methods of 
proof combine classical techniques of weak convergence and strong mixing (e.g. Billingsley m) with 
extreme value theory for dependent sequences (e.g. Davis and Mikosch H). The proofs are rather 
technical due to the fact that the sequences of indicator functions (It) have triangular structure: 
they change in dependence on the threshold a m . 

As in classical time series analysis, the functional central limit theory for the integrated peri¬ 
odogram can be used to construct asymptotic goodness-of-ht tests such as the Grenander-Rosenblatt 
and Cramer-von Mises tests. In contrast to their classical counterparts, these tests are based only 
on the extremal part of the underlying sample, i.e., we test whether the extremes of the sample are 
in agreement with the null hypothesis about a given type of time series model. Such tests may be 
useful, for example, for distinguishing between a GARCH and a stochastic volatility model fitted 
to a return time series. The aforementioned two types of models may have similar autocorrelation 
structure for the data, their absolute values and squares, so their spectral properties are very sim¬ 
ilar as well, while their extremograms are rather distinct: the extremogram j A relative to the set 
A = (l,oo) decays exponentially fast for GARCH and for the simple stochastic volatility model r ) A 
vanishes at all positive lags; see Davis and Mikosch [7]. 

The paper is organized as follows. We start in Section [2] with some moment calculations and we 
also introduce the relevant mixing conditions and central limit theory for the sample extremogram. 
In Section fe.dl we provide a result about the mean square consistency of the integrated periodogram; 
the proof is given in Section [5] The main results (Theorems [15] and 1171) are functional central limit 
theorems for the integrated periodogram. They are given in Section [3] the corresponding proofs 
are provided in Sections [S] and [7] The covariance structure of the limiting Gaussian processes in 
Theorem [15] is rather complicated. Therefore in Section |4] we supplement the asymptotic theory by 
consistency results for the stationary bootstrap applied to the integrated periodogram of extremal 
events in a strictly stationary sequence. The corresponding proofs are given in Section [8] In 
Section 14.41 we indicate how the integrated periodogram works for simulated and real-life data. 


2. Preliminaries 

2.1. Some moment calculations. Recall the notation and conditions of Section [I] We write 
Po = P( a m Xq £ A) and pn = P( a rn Xo £ A, a^Xh £ A ), h > 1, 
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where as above, m n -A oo and m n /n = o(l) as n —> oo. For integers s, t,u,v > 0, we set 

Ei s i t i u i v , 

T(s,t,u) = EI s I t I u , 
r (s,t) = Ei s i t =p\ s -t\ ~pI- 

We will often have to calculate variances and covariances of the sample extremogram 7 A . We 
provide some of these formulas for further use. 


Lemma 1. Let (X t ) be a strictly stationary sequence. Then, for 1 < h < n — 1, 

n—h—1 

{n/m) 2 EP)\{h) = (n — h)E(I 0 I h ) 2 + 2 (n — h — t)T(0,h,t,t + h) 

t -1 

and for l<h<h + u<n— 1, 

(■ n/m ) 2 E^ A (h)j A (h + u) 

= (n — h — u)T(0,h,0,h + u) 

n—h—u —1 

+ (n — h — u — t)r(0, /i, t + /i + w) 

t=i 
n— h —1 

+ min(n — h — u, n — h — f)r(0, h + u, t, t + h). 
t= 1 


2.2. Mixing conditions. The following two mixing conditions were introduced in Davis and Mikosch 
[?3 for a strongly mixing Revalued sequence (X t ) with rate function (fh)- 


Condition (M). There exist integer sequences m = m n —> 00 and r n —>■ 00 such that m n /n —> 0, 
r n /m n —> 0 and 

OO 

(2.1) lim m n V' f h = 0, 

n—>• 00 z ' 

h=r n 


Moreover, an anti-clustering condition holds: 

r n 

(2.2) lim limsupy^P(|X h | > ea m \ |X 0 | > ea m ) = 0, e>0. 

fe->oo n ->- 00 


Condition (Ml). Assume (M) and that the sequences (m n ), (r n ), k n = [ n/m n \ from (M) also satisfy 
the growth conditions ~^ O7 and m n = o(n 1 / 3 ). 

Remark 2. The condition m n = o(n 1 / 3 ) in (Ml) can be replaced by " lr ^ n —► 0 and ^ t 

0 which is often much weaker. 


Condition (ED is easily satisfied if the mixing rate (^) is geometric, i.e., exponentially decaying 
to zero. Under mild conditions, the popular classes of ARMA, max-stable, GARCH and stochastic 
volatility processes are strongly mixing with geometric rate; cf. Davis et al. id uni ed m] for 
discussions of these examples. Condition (12.21) is similar to (2.8) in Davis and Hsing [B], It serves 
the purpose of establishing the convergence of a sequence of point processes to a limiting cluster point 
process. This condition is much weaker than the anti-clustering condition D'(ea n ) of Leadbetter; 
cf. Section 5.3.2 in Embrechts et al. m- 

The mixing rate (fh) in conditions (M) and (Ml) is useful for finding bounds on the moments 
T(s,t,u,v) introduced above. In what follows, c will denote any (possibly different) constants whose 
value is not of interest. 
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Lemma 3. Let ( Xt ) be a strongly mixing sequence with mixing rate (£/i). Then for integers h,l,u> 1 
and for some constants c > 0 which do not depend on n, 

(2.3) |T(0, h,h + l,h + l + u)\ < c min^, £u) , 

(2.4) \T(0,h,h + l,h+l + u) - (Ph ~ pl)(Pu ~ pl)\ < c& , 

(2.5) |T(0, h,h + l)\ <c min (&,&), 

(2.6) |r(o,fc)|<&. 

The proof of Lemma [3] follows by a direct application of Theorem 17.2.1 in Ibragimov and Lin- 
nik DU- Relation m combined with (EH) will ensure that sums of T(0, h,h + l,h + l + u) are 
asymptotically negligible if h or u exceed r n . 


2.3. Central limit theory for the sample extremogram. In this section we recall a central 
limit theorem for the extremogram from Davis and Mikosch [7], Section 3. 

Lemma 4. Assume that ( X t ) is an M. d -valued strictly stationary regularly varying sequence with 
index a > 0 and that the Borel set A satisfies the conditions of Section \1.2\ If the mixing conditions 
(M), (Ml) hold and 7 a{1) < oo then for h > 0, 

(2-7) 7 A(h) 4 7 A (h), 

( 2 - 8 ) {n/m) 1/2 (j A (i)-E^ A (i)).^ 0 ^ h 4 (Zi) i=0 ,...,h, 

where (^)i=o,...,ft, is Gaussian with mean zero and covariance matrix = (uij)ij=o,...,h given by 

OO 

1=1 


and for u,s,t > 0 , 

7a(«,M) = lim nP(a~ 1 X 0 &A,a~ 1 X u &A,a~ 1 X s ^A,a~' l X t &A), 

n—> oo 

with the convention that 7A(t«,t) = 7a(m,m, t). Moreover, we have for h> 1 

(2.9) PA^h) -A PA(h), 

( 2 . 10 ) (»/»)■/»(«(•}.„ 4 . A . 

Proof. The proof of (12.71) was given in Section 3 of Davis and Mikosch [7] . There we can also find the 
proof of (12.81) in a more general context. Here we will calculate the covariance matrix E/j explicitly. 
The expressions for an, i > 0, were derived in Davis and Mikosch [7] for i = 0 and i > 1 in Theorem 
3.1 and Lemma 5.2, respectively. We notice that 7 , 4 ( 2 , M + j) < 7 a(1) and therefore the infinite 
series in 07,- are finite. 
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For i j, similar calculations as for Lemma [l] yield for k > 1 and r n /m n —> 0, 

n n 

m rfirTtlt+i^Us+j) 


-COY 


t—1 


8=1 


n 

iT(0,0,i,j)+m ^2 [(! ~ l/n)[T(0,i,l,l+j) 


1 = 1 

+F(0, j, l, l + i)\- (Pi - Po)(pj - Po) 

k r n n 

= mr(0,0,i 1 j) + m(X;+ 5Z + ^2 ) ( 1_ V n )[ r (M,U +j) 

1=1 l=k-\-l l=r n -\-1 

+r (0 ,j,l,l + i)\ - (Pi - Po)(pj - Po) 

= Qi + Q2 + Q3 + Qa ■ 

By regular variation, for fixed k > 1 as n —> 00 , 

k 

Qi + Q2 -> 7 A(i,j) + ^2 + j) + 7A(j,l,l + i)\ , 

i=i 

and the right-hand side converges to < 7 ij as k —> 00 . By (12.21) . we have 

lim lim sup | <3 31 = 0 . 

k—too n—too 

Using din and ED, we also have IQ 4 I < cm„ E;= r „+i ^ —> 0 as n —> 00 . This proves (12.71) 
and (12.81) . Relations (12.91) and (12.101) follow by a continuous mapping argument, observing that for 
1 < i < h. 




n \ 1/2 7a(«) - Ej A (i) 


7a(0) 


(n/m) 1 / 2 ^^) -Ej a (0)) 

-^ aW — mmm — +or{1) 

[Zi - p A (i)z2j ■ 


7a(0) 


□ 


□ 


Remark 5. The summability condition on 7^4 which we assume in the previous lemma and through¬ 
out this paper is satisfied for a large variety of regularly varying time series models; see the calculation 
of 7 a in Davis et al. mmm- For example, finite order ARMA models with regularly varying 
iid noise and GARCH models have exponentially decaying extremogram, and the simple stochas¬ 
tic volatility model with log-normal volatility process has vanishing extremogram at all positive 
lags. Formulas for 7,4 also exist for infinite variance stable and max-stable processes with Frechet 
marginals. Also for these processes the summability condition on 7,4 may hold, depending on the 
specification of the process. 

Recall that a strictly stationary process (Xt) is 77 -dependent for some integer 77 > 0 if (At)t<o 
and (Xt)t>rj are independent. For such a process we observe that cruh = 0 for h > 77 and hence (12.81) 
collapses into ( n/m)°- 57 y A (h ) -A- 0 for h > 77 . In particular, for an iid sequence (X t ), Zf t = 0 a.s. for 

h > 1, while (n/m ) 0 5 7 , 4 ( 0 ) -4 Z 0 and Z 0 is N(0, 7 a( 0)) distributed. 

In these cases, the rate of convergence in (12.81) can be improved. 
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Lemma 6 . Assume that ( Xt) is an -valued rj-dependent regularly varying strictly stationary 
sequence with index a > 0 for some 77 > 0, and the Borel set A satisfies the conditions of Section \l.2\ 
Additionally, assume that for j > i > p and 1 <t<rj—(j — i), the following limits exist: 

7 + 

= lim m 2 P(af l 1 X 0 G A, af^X t G A, af^Xi G A, af^X t+:j G A). 

m—too 

( 2 . 11 ) 

Then for h > 1, n 05 (j a(ii + i)) i=1 h -4- (/?*)*=where (Zf) i= is Gaussian N( 0, E/,) 
whose covariance matrix is given by 

v-(j-i) 

(2-12) f Tij = 7a(0)7a(j - i) + [7a(M, * + .?)+7a(*>.?>* + *)] > 

t= 1 

1 < * < j. 

Remark 7. Condition (12.111) is an additional asymptotic independence condition. Indeed, regular 
variation of (Xt) only implies that the limits 

lim mP(af l 1 X 0 G A,a~ x X t G A, alfXi G A,aZ}X t +j G A) 

m—t oo 

exist and are finite. Then (12.111) implies that the latter limits must be zero. In Example [9] we 
consider some simple cases when (12.111) is satisfied. 

Remark 8. Assume j —i > g. Then, by ^-dependence, 7 a( j —i) = 0 and the index set in (12.121) is 
empty. Hence cy, = 0 for j — i > r). In particular, if (Xt) is iid, Oi 3 = 0 for i ^ j and ay = 7a (0)- 

Proof. We start by calculating the asymptotic covariances. Assume j > i > 77 . Then, using the 
independence of Iq and (Ij , I,.IfJt+j, IjIth+i) for t > g and of I t +j and for t < rj and 

t > r/ — (j — i), we obtain 

cov (n°’ 5 7A (i ), n°' 5 7A ( j )) 

= m 2 EI^EItlj + to 2 'y ( [Elgliltlt+j + Eloljltlt+i] + o(l) 

t =1 

= 7a(0)7a(j —i) +m 2 E [EloIJtlt+j + EIo ]+0( 1) 

t=l 

V-(j-i) 

-> 7a(0)7a(j - *) + ^2 ^A^PA + j) +7A^.i^ + *)] > n->oo. 
t =1 

In the last step we used (12.111) . This completes the calculation of E^. Furthermore, we observe that 
for h > 1, 

n 

«°' 5 (7 A(*)) i=v+1 _ v+h = (m/n°- 5 )J2 (lJt+i ) i=ri+h + Ml) ■ 

t= 1 

(2.13) 

The vector sequence (Itlt+i)i=r)+i,...,r)+hi t = 1,2,..., is strictly stationary and (h + /^-dependent. 
Now an application of the central limit theorem for strongly mixing triangular arrays in Rio |27j 
and the Cramer-Wold device to (12.131) conclude the proof. □ □ 


The following examples fulfill the conditions of Lemma |6] 
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Example 9. An iid regularly varying sequence (Xt) is O-dependent, and thus (12.111) holds. Its 
limiting covariance matrix is a diagonal matrix with entries 7 ^( 0 ) = (pi(A)) 2 on the main 
diagonal. 

We consider the stochastic volatility model X t = a t V t where ( a t ) is independent of ( V t ), (tr t ) is 
a positive ^-dependent strictly stationary sequence and (Vt) is a regularly varying iid sequence with 
index a > 0; see Davis and Mikosch [8j. Assume that Ea a+e < oo for some e > 0. In this case, ( X t ) 
is ^-dependent, strictly stationary and regularly varying with index a. We will show that (12.111) 
holds with j A (u, s,t) = 0 for 0 < u < s < t. Since A is bounded away from zero, there exists a 
S > 0 such that 


7 A (w,s,f) 

< limsupm 2 P(a“ 1 min(|X 0 |,|X„|,|A' s |,|X t |) >6) 

m—too 

< limsupm 2 P(a“ 1 max(cro,o-„,tT s ,cr t ) mill (IK)|,|K|,| 1 l4|,|V t |) > S) 

m—> OO 

< limsup4m 2 P(a“ 1 cr 0 min(|Vb|, \V U \, ||, | V* |) > 6) 

m—too 

< limsupcTO 2 (Pcr“) 4 (P(|Vo| > a m 5)) 4 = 0 , 

m—>oo 


where we used that P(cr 0 1Vo| > a m ) ~ Ea a P(\Vo\ > a m S) by virtue of Breiman’s lemma; see [ 2 ]. 

In the iid case, the limiting quantities Zh, h > 1, in Lemma 0] vanish. The same observation can 
be made in the case of a strictly stationary sequence with asymptotic (extremal) independence in 
the following sense: 

Condition (AI): Assume there exist sequences m = m n —> oo and r n —> oo such that m = o(n) and 
r n = o(m) as n —> oo and the following conditions are satisfied for any Borel set A C bounded 
away from zero and the axes such that fi\(dA) = 0: 

( 1 ) lim n _ ) . 00 m 2 ph exists and is finite for h > 1 , 

(2) lim „_ ) . 00 m 2 sup^^^ P(a“ 1 .A 0 e A, a^Xi e A, a~ x Xj e A) = 0, 

(3) lim n—> oo Tn m 2 P(a m J A'o £ A , Xi £ A , a^Xj £ A, Xt £ A) — 0 . 

Example 10. We consider the stochastic volatility model from Example[9]but we drop the condition 
of ^-dependence. Conditions (AI.2) and (AI.3) are verified in the same way as in Example [H We 
also observe that for some constant c > 0 , 

2 ^ P( a rnXo £ A.a^Xh € A) 

m Ph C P(mm(Vi,V 2 ) > a m ) 

c P(am diag(qo,gh)(V'i, E 2 )' € A x A) 

P(min(Vi, y 2 ) > a m ) 

An application of a Breiman-type result for regularly varying vectors on cones due to Janssen and 
Drees m ensures the existence and finiteness of the limits linim-^oo m 2 ph for h > 1. This is (AI.l). 

Lemma 11. Assume that (X t ) is an -valued strongly mixing strictly stationary regularly varying 
sequence with index a > 0 and that the Borel set A satisfies the conditions of Section \1.2\ We also 
assume the asymptotic independence condition (AI) and the mixing condition 


lim rn 

n—> oo 


H & = 0 • 

h=r n 


(2.14) 
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Then 

(2.15) 
where (Zi)i— i. 


7 A{h) 4 0, h> 1, 

n °' 5 ~ Ej A {i)) h 4 , 

t h are independent Gaussian with mean zero and variances 
var(Z,) = lim m 2 pi , i > 1 . 

m—too 


Proof. We will apply the central limit theorem in Rio m for strongly mixing triangular arrays to 
the left-hand side in (12.151) . For this reason, we have to calculate the asymptotic covariance matrix 
of the left-hand vector. We observe that for fixed j > i > 1, in view of the mixing condition (12.141) 
as n —> oo, 

cov(n°- 5 7 j4 (*),n 0 - 5 7A(i)) 

n 

= m 2 cov(7 0 7„7 0 7) + m 2 ^2 [cov(7 0 7j, lJt+ 3 ) + cov(7 0 7 i , 7 t 7 t+i )] + o(l) 

t=l 

r n 

= m 2 cov(7 0 7„7 0 7 t ) + to 2 ^2 [cov(7 0 7, ijt+j) + cov(7 0 7j, 7 t 7 f+i )] + o(i). 

t= 1 

(2.16) 

Condition (AI) implies that m 2 cov(/o/j, Ioh) —> 0 as m —> oo. The same argument also implies 
that the first j summands in (12.161) vanish as n —> oo. Therefore it suffices to consider 

r n 

m 2 E [co v(/ 0 /i, Ith+j ) + cov(I 0 Ij,ItIt+i)\ ■ 

t=j+i 

In the latter sum, the indices 0, i, t, t + j are distinct and the same observation applies to 0, j,t,t + i. 
Direct calculation with condition (AI) shows that this sum is asymptotically negligible. This implies 
that the covariance matrix of the limiting vector is diagonal. The calculation of the asymptotic 
variances is similar by observing that as n —> oo, 

var(n°- 5 7 A (/ l )) 

n 

= m 2 var(7 0 7/ t ) + 2 m 2 ^ cov(7 0 7i, IJt+i) + o(l) = m 2 p h + o(l). 

t -1 

□ 


^ p 

Remark 12. Although 7 A {h) — > 0, h > 1, it is in general not possible to avoid centering in (12.151) . 
However, under (AI.l), n°' 5 E 7 y A (h) —>• 0 if n/m 2 = o(l) as n —> 00 , and the latter condition can 
even be weakened if m 2 (ph — p^) —> 0 as m —> 00 . 


2.4. Mean square consistency of the integrated periodogram. Recall the definitions of 
Jn,A{g) and J A {g) for g € T+(n) from (11.41) and (11.51) . respectively. The following elementary 
result deals with the convergence of the first and second moments of J n ,A(g) for a given function g. 

Lemma 13. Consider an M. d -valued strictly stationary regularly varying sequence (X t ) with index 

a > 0. Assume that the Borel set 4cl 0 satisfies the conditions of Section \l.'2l 5777 7 a. (0 < 00 
and (M) holds. Then the following asymptotic relations hold for g £ L?_(n). 

1 . EJ ntA (g) -A J A (g) as n —> 00 . 
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2. If in addition, m log 2 n/n = 0(1) as n -A oo, and there exists a constant c > 0 such that 
(2.17) \c h {g)\<c/h, h> 1, 

then E(J n)A (g ) - Ja(s)) 2 -t 0 and J° jA (g) 4 J A (g) as n oo. 

The proof of the lemma is given in Section [5] 

Remark 14. Condition (12.171) holds under mild smoothness conditions on g , e.g. if g is Lipschitz or 
has bounded variation on II; see Theorem 4.7 on p. 46 and Theorem 4.12 on p. 47 in Zygmund 1301 . 

3. Functional central limit theorem for the integrated periodogram 

Recall the definition of the spectral density h A from Section 11.41 In this section, we assume 
that the weight function g is a non-negative continuous function. Abusing notation, we define the 
empirical spectral distribution function with weight function g by 

(3.1) Jn,A (x) = Jn,A^gI[0 ,x]) = / In,A (X) 9 (4 d\ , X II . 

Jo 

Under the conditions of Lemma 1131 again abusing notation, we have 

P [ x 

Ju,a(x) -A- J a (x) = J A {gI[o, x }) = / h A (X) g(X) dX , x G II. 

Jo 

In view of the monotonicity and continuity of the functions J n ,A and J A we also have 

(3.2) sup | J n ,A(x) - J A (x )| 4 0 . 

xGlI 

Our next goal is to complement this consistency result by a functional central limit theorem of the 
type (n/m) 0 5 (J n , A — J A ) 4 G , in C(II), the space of continuous functions on II equipped with the 
uniform topology, for a suitable Gaussian limit process G. 

However, this result is unlikely to hold in general, due to asymptotic bias problems. It is men¬ 
tioned in Davis and Mikosch [7J in relation with the central limit theorem for the sample extremogram 
(see Lemma H] above) that the pre-asymptotic centerings E"f A (i) = ((n — i)/n)m(pi — Pq) can in 
general not be replaced by their limits 7a(*) due to the failure of the relation ( n/m)°' 5 \m(pi — 
Pq) — 7a(*)I —> 0 as n —> oo. Therefore we will equip the empirical spectral distribution func¬ 
tion J n , A with the pre-asymptotic centering EJ n ^ A . It follows from Lemma 1131 that under (M), 
EJ n ^ A (x) -A- J A (x) for every x £ n, and again using monotonicity of EJ n A and J A , we have 
su Pzen \EJ n , A {x) - J A {x)\ -A 0. 

We observe that 

n— 1 

Jn,A {x) = M^A( 0 ) + 2 ^ h ( X ) 7A (ft) , 

h= 1 

n—1 

Jn, A (4 = 'lpo(x) + 2 ^2,lfh{x) p A (h) , 

h =1 

where ^(x) = cos(/iA) g(X) d A , x G II. We also consider a Riemann sum approximation of the 

coefficients ^(x) at the Fourier frequencies uj n (i) = 2m/n G II given by 

$h(x) = — y^g(w n (i))cos(huj n (i)), xeU, 

n z —' 

2=1 
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where x n = [mr/27r]. The corresponding analogs of J n ,A and J° A are then given by 

n— 1 

Jn,A( x ) — { x )lA ( 0 ) + 2 ^ ij) h (x) 7 A jh ), 

/i=l 

n— 1 

4, A (4 = ^o{x) + 2 ^ {x) PA (h) , 

h=l 

Now we are ready to formulate the main result of this paper. 

Theorem 15. Assume that ( X t ) is an W d -valued strictly stationary regularly varying sequence with 
index a > 0 and the Borel set A C R 0 is bounded away from zero, pi(dA) = 0 and pi(A) > 0. 
Let g be a non-negative (3-Holder continuous function with (3 6 (3/4,1], If the conditions (Ml) and 
YliZilAil) < oo hold then in C(II), 

(3.3) (n/m)°- 5 (J n , A - EJu,a) 4 G, n -A oo, 

(3.4) (n/m) 0 ' 5 (J n>A — EJ nA ) 4 G, n -A oo , 
where the limit process is given by the infinite series 

OO 

(3.5) G = if 0 Z 0 + 2Y^hZ h , 

h= 1 


which converges in distribution in C(II) ; (Zh) is a mean zero Gaussian sequence such that (Zq, ..., Zh) 
has the covariance matrix (S^), h > 0, given in Lemma [/} Moreover, the following limit relations 


hold 





(3.6) 

(n/m) 05 (J° A — EJ n 

,a/( mpo)) 

d 

-> 

G° , n —> 00 

(3.7) 

(n/m) 0 - 5 (J° A -EJ n 

,a/( mpo)) 

d 

G° , n —> 00 


where the limit process is given by the infinite series 


G° 


2 

7a(0) 


Y^ h ( Zh 

h= 1 


p A (h)Z 0 ). 


The proof of this result is given in Section [ 6 ] 


Remark 16. For practical purposes, the discretized version J n , A will be preferred to J n ,A since 
it does not involve the calculation of integrals. Moreover, since Y^t=i e luln ^ t = 0 for u>„(j) € 
( 0 , 7 r), centering of the indicators It with the unknown parameter po in the periodogram ordinates 
In,A(u n (j)) = ( m / n )\ X4=i is not needed. 


For an ^-dependent sequence ( X t ), we know that Zh = 0 a.s. for h > rj. Then we conclude 
from Theorem m and Lemma |4] that the limit process G collapses into G = ifoZo + 2 J2h= l ^PhZh ■ 
However, taking into account Lemma [6l a more sophisticated result with a different convergence 
rate can be derived. The corresponding result for J° A is similar and therefore omitted. 

Theorem 17. Assume that ( X t ) is an R d -valued strongly mixing strictly stationary p- dependent 
regularly varying sequence with index a > 0 for some 77 > 0 and the Borel set A C Mq is bounded 
away from zero, p\(dA) = 0 and pi(A) > 0. Also assume that the limits in (12.111) exist. Let g be a 
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non-negative (3-Holder continuous function with (3 G (3/4,1]. Then the relations 

v 

Vn(Jn,A - IpOlAiO) - ^hlA{h)) 4 G, 

h= 1 
V 

Vn(J n , A ~ ^o7a(Q) ~ 2 ^ dhTYAjh)) 4 G, 

/i=i 

hold in C(n), where the limit process is given by the a.s. converging infinite series 

OO 

g = 2 ^ 3 

h=l 

and (Zf i) is a mean zero Gaussian sequence such that (Z ±,..., .Z^) /ios covariance matrix h > 1, 
given in Lemma\Q 

The proof is given in Section [7] 

Example 18. Assume that (Xf) is an iid regularly varying sequence with index a > 0. Then (Zh) 
is an iid mean zero Gaussian sequence with var (Z) = 7 ) 4 ( 0 ) = (pi(A)) 2 . If we choose the function 
g = 1 we obtain 

ifhix) = [ cos(hX)dX = h> 0, xSlI, 

J o h 

and 

c(x) = 2 xen. 

h=X 

We notice that G is a series representation of a Brownian bridge; see Hida [IB] . 

In the case of asymptotic (extremal) independence a result similar to Theorem IT7l holds. 

Theorem 19. Assume that (X t ) is an R d -valued strictly stationary regularly varying sequence with 

index a > 0 and the Borel set A C K 0 bounded away from zero and the axes, pi(dA) = 0 and 
pi(A) > 0. Also assume the mixing condition (12.141) and the asymptotic independence condition 
(AI). Let g be a non-negative (3-Holder continuous function with (3 £ (3/4,1], Then the relations 

V^((Jn,A - EJ nA ) - V>o(7a(0) - £7a(0))) 4 G , 

y/n((J n ,A ~ EJ H}A ) ~ V’o(7-4(0) - Ej a (0))) A G, 

hold in C(II), where the limit process is given by the a.s. converging infinite series 

OO 

G = 2 £ th. Z h , 

h= 1 

and (Zh) is a sequence of independent mean zero Gaussian variables with variances var (Zh) = 
lilTL m _).oo m 2 p h , h> 1. 

The proof is based on Lemma 1111 and tightness arguments which are similar to the proofs of 
Theorem m and ED We omit further details. In view of Remark [T2l centering in Theorem 111)1 can 
be avoided if n/m 2 = o(l) as n —> 00 . 

As in classical limit theory for the empirical spectral distribution (see Grenander and Rosenblatt 
[X4l . Dahlhaus 0 ). an application of the continuous mapping theorem to Theorems 1151 and 1 1 71 yields 
limit theory for functionals of the integrated periodogram. These functionals can be used for testing 
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the goodness of fit of the spectral density of the time series model underlying the data, under the 
null hypothesis that the model is correct. From Theorem [15] we get the following limit results for 
the corresponding test statistics. 

• Grenander-Rosenblatt test: 


(3.8) 


( n/m ) 


0.5 


sup 

xGlI 


Ju,a(x) - EJ U: a(x) 


-4- sup|G(x)|. 

ccElI 


• uj 2 - or Cramer-von Mises test: 

(n/m) f (j n ,A(x) — EJ u ^a( x)) dx -4 f G 2 (x)dx. 

iien ' ' Jxeu 

If (X/) is an ^-dependent sequence satisfying the conditions of Theorem 1171 the corresponding limit 
results read as follows: 


• Grenander-Rosenblatt test: 

v 

\fn sup J n ,Ai x ) ~ ^o(*)7a(0) - V’/iOOtaW -t sup |G(x)|. 


xGll 


h=1 


(3.9) 


w 2 -statistic or Cramer-von Mises test: 


[ (Jn,A(x) — ■0o(®)7a(O) — 2^ iph(x)jA(h )) 2 dx -4 f G~(x)dx. 
J xElI u i J sGlI 


(3.10) 


In Figures [Hand [2] we show the estimated densities of the test statistics in (13.911 and (13.1011 for n = 
2, 000 and n = 10, 000, for different thresholds a m and g = 1. We compare the estimated densities 
with their corresponding limits. The samples are iid f-distributed with a = 3 degrees of freedom. 
We mention that the density of sup^gn |G(x)| is given by 47r -2 l) J+1 xexp ( — j 2 x 2 /7 r 2 ), 

x > 0; see Shorack and Wellner [28]. We use the identity in law f x£n G 2 (x)dx = (2/j 2 )A( 2 

for an iid standard normal sequence (Nj) (see [21]) for the simulation of the limiting density of the 
w 2 -statistic. 

Not surprisingly, these graphs show that one needs rather large sample sizes to make the tests 
reliable. The Grenander-Rosenblatt statistic shows a better overall behavior in comparison with the 
w 2 -statistic. The distribution of the former statistic is close to its limit for a variety of thresholds 
like po = 0.1,0.05 and even for po = 0.03. In contrast, the w 2 -statistic is rather sensitive to the 
choice of threshold and sample size; the best overall approximation is achieved for n = 10, 000 and 
Po = 0.05. For applications, one would need to focus on the quality of the approximation of high/low 
quantiles of the test statistics by the limiting quantiles. This task is not addressed in this paper. 


4. The bootstrapped integrated periodogram 

With a few exceptions, the limit processes G and G in Theorem [15] and Q7] have an unfamil¬ 
iar dependence structure and then it is impossible to give confidence bands for the test statistics 
mentioned in the previous section. One faces a similar problem when dealing with the sample 
extremograms whose asymptotic covariance matrix is a complicated function of the measures p,h 
in CL2D- Davis et al. [ID] proposed to apply the stationary bootstrap for constructing confidence 
bands for the sample extremogram. The stationary bootstrap can also be used for the integrated 
periodogram, as we will show below. 
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Figure 1. Density of the left-hand side in (13.91) with 77 = 0 (dotted line) and its 
limit sup^gn |G(x)| (solid line) for g = 1 . We choose the set A = (l,oo), different 
thresholds a m with po = P(X > a m ) and different sample sizes n. The underlying 
sequence (X t ) is iid t-distributed with a = 3 degrees of freedom. The sample sizes 
are chosen as n = 2,000 in the first row and n = 10,000 in the second row. The 
thresholds a m are chosen such that po = 0.1 in the first column, po = 0-05 in the 
second column and po = 0-03 in the third column. 


4.1. Stationary bootstrap. The stationary bootstrap was introduced by Politis and Romano [23] 
as an alternative block bootstrap method. First, we describe this procedure for a strictly stationary 
sequence (Y t ). Given a sample Y 1: ...,Y n , consider the bootstrapped sequence 

(4.1) j • • • j — 1 j ■ ■ • j Yr n , . . . , Yk n -\-Ij N — 1 , . . . , 

where (Y)), (Ki), (Li) are independent sequences, (Ki) is an iid sequence of random variables 
uniformly distributed on {l,...,n}, (Li) is an iid sequence of geometrically distributed random 
variables with distribution P(L 1 = i) = 9(1 — 9) l ~ 1 , i = 1,2,..., for some 9 = 9 n € (0,1) such 
that 9 n —> 0 as n —> 00 and N = N n = inf{i > 1 : J2j=i Lj > n}. If any element Y t in 
dUD has an index t > n, we replace it by Y t mo d n■ As a matter of fact, (Y t )t> 1 constitutes a 
strictly stationary sequence. The stationary bootstrap sample is now chosen as the block of the 
first n elements in S3D- In what follows, we write (Y t *)t> 1 for the bootstrap sequence S31), 
indicating that this sequence is nothing but the original Y -sequence sampled at the random indices 
(K 1 ,..., K\ + L\ — 1 , K 2 ,..., K 2 + L 2 — 1 ,...) with the convention that indices larger than n are 
taken modulo n. 

In what follows, the probability measure generated by the bootstrap procedure is denoted by P*, 
i.e., P*(-) = P(- | (X t )). The corresponding expected value, variance and covariance are denoted by 
E*, var* and cov*. 
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Figure 2. Density of the left-hand side in (13.101) with 77 = 0 (dotted line) and its 
limit f xen G ( x ) dx (solid line) for g = 1. We choose the same setting as in Figure[2] 


4.2. The bootstrapped sample extremogram. Davis et al. [TO] applied the stationary bootstrap 
to the sequence of lagged vectors 

h{h) = {It , Ith+i, ■ ■ ■, Ith+h ), t = 1,2,..., 

for fixed h > 0 and showed consistency of the bootstrapped sample extremogram. In particular, they 
showed the following result which we cite for further reference. A close inspection of the proof in 
m shows that the results remain true if in / t (/i) we replace the quantities I s by / s , s = t,... ,t + h. 
We denote the corresponding vector by It{h). Consider the stationary bootstrap sequence {I t *{h)) 
and write 

n—i 

7 Hi) =—^TfTf+i, i = 0,...,h. 

n t! 

Theorem 20 . Consider an M. d -valued strictly stationary regularly varying sequence (Xt) with index 
a > 0 and assume the following conditions: 

1. The mixing condition (Ml) and in addition h£h < °°- 

2. The growth conditions 8 = 9 n ^ 0 and n6 2 /m — > 00 . 

3. The set A is bounded away from zero, gi(dA) = 0 and gi{A) > 0. 

Then the following bootstrap consistency results hold for h > 0: 

E* (jaW) lA{h) and var* ((n/m) 05 7 ^(/i)) 4 a hh , 

where the covariance matrix = (ay,) is given in Lemma\Q Moreover, writing d for any metric 
describing weak convergence in Euclidean space and (.Zi), = o,...,/j for an N(0,Y,h) Gaussian vector, 
we also have 

d^{n/m) 1/2 ( 7 yf i {i) ~j A {i)) i=0> h ,{Zi) i=0 ,...,hj 4o, n-> 00 . 
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In what follows, we will write d for any metric describing weak convergence in any space of 
interest. 


4.3. The bootstrapped integrated periodogram. Bootstrapping the sequence (I t (h)) has the 
advantage that we preserve the neighbors If+i of If from the original sequence (/ s ). However, this 
method depends on the lag h and creates problems if the number of lags increases with the sample 
size n. In what follows, we will apply the stationary bootstrap directly to (It). Then we have to 
re-define the bootstrap sample extremogram at any lag h < n. Write 

n 

I n = n -1 I t and I t = I t - I n , teZ, 
t =1 

and define the corresponding bootstrap sample extremogram 

n—h 

7 a 0 ) = Tfht+hy > h = 0 , ... ,n — 1 , 

1 t= 1 

and the bootstrap periodogram 


CAA) = ^| 




—it A 


A e n. 


Note the crucial difference: in general, Ifl(t+h)* 7 ^ Iflf+h , but, as we will see in Lemma E5l the 
quantities 7 ^ (h) and 7 A (h) are asymptotically close for fixed h > 0 . 

In what follows, we focus on the bootstrap for the continuous version J n ,A of the integrated 
periodogram for a given smooth weight function g\ bootstrap consistency can also be shown for the 
discretized version J u ^a', we omit further details. In the definition of J n ,A in (13.11) . we simply replace 
(It) by (If), resulting in its bootstrap version 


,.A n -1 

Ju,aW = / I n,A(x)g(x)dx=i>ol*A(^)+ 2 H' l P h TA(h), Aen. 

J ° h =1 

Now we can formulate a bootstrap analog of Theorem [15] which shows the consistency of the 
stationary bootstrap procedure. 


Theorem 21. Assume the conditions of Theorem \15\ and \2(A Then 

d^n/m) 1 ' 2 (J* tA - E*J* a ) , G) 4 0 , n -> 00 , 

where the Gaussian process G is defined in Theorem \15\ and d is any metric which describes weak 
convergence in C(n). 


Remark 22. Recall that, in general, it is not possible to replace the centering EJ n ^ of J n ,A in 
the functional central limit theorem of Theorem 1151 by its limit f Q Ia(^) g( A) dX. A similar remark 

applies to Theorem I2T1 Although sup Agn \E* J* A (\) — J n ,A(A)| —> 0, under the conditions of 
Theorem EU it is in general not possible to replace the centering E*Jf A by J n ,A', see Lemma [28] 
Thus, Theorem 1211 does not yield bootstrap consistency in a textbook sense but it rather provides 
a simulation technique for the limit process G. In turn, the simulation of this process makes it 
possible to provide confidence bands for the goodness of fit test statistics considered above. We will 
apply this simulation procedure in Section [4.41 



18 


T. MIKOSCH AND Y. ZHAO 


4.4. A simulation study. We focus on the Grenander-Rosenblatt statistic (GRS) on the left- 
hand side of (EH) for different time series models, distinct thresholds and sample sizes. Under 
the null hypothesis of a particular time series model, one can simulate the quantiles of the GRS 
from the theoretical model. In this study we also follow a different approach. First, we determine 
the expected value function EJ u a and the threshold a m such that po = P(X > a m ) = 1/m 
by simulation from the theoretical model and then we use the stationary bootstrap to calculate 
the asymptotic quantiles of the GRS. This distribution is be obtained by repeated simulation of 
(n/m) 0 ' 5 sup^gjj | J* A (x) — E*J* A (x)|; Theorem [7T1 provides a justification for this approach^ In 
the cases when the expected value function EJ nA can be replaced by its limit, i.e., when the bias 
of J n ,A is negligible, this approach has the advantage that the test is non-parametric. An example 
are models satisfying the asymptotic independence condition (AI) and n/m 2 —> 0 as n — > oo; see 
Theorem [T9] and the remark following it. Of course, for an iid sequence or ^-dependent sequence one 
can also use the quantiles of the limit distribution of the GRS which are known or can be simulated; 
see (13.91) and (13.1011 . 

In what follows, we apply the Grenander-Rosenblatt test (GRT) to various univariate (real-life 
or simulated) time series Xt, t = 1,..., n for different sample sizes n and thresholds a m . We always 
choose A = (1, oo) and g = 1. Whenever we apply the stationary bootstrap we choose the geometric 
parameter 0 = 1/50. Density plots and simulated quantiles are derived from 4,000 independent 
repetitions, also in the bootstrap case. 

In Figure |3] we illustrate how the stationary bootstrap works for different thresholds a m and 
sample size n = 2,000. We show the density of the normalized GRS on the left-hand side of 
(13.81) and its bootstrap approximation. We choose regularly varying ARMA(1,1) and GARCH(1,1) 
models. The densities of the GRS and its bootstrap approximation are close to each other. We 
take this fact as justification for using the bootstrap quantiles of the GRS in the test. While the 
densities in the ARM A case do not seem too sensitive to the choice of the high threshold a m , the 
shape of the densities change for the GARCH model when switching from po = 0.10 to po = 0.05, 
while they look similar for po = 0.05 and po = 0.01. 

In Figure [4] we show sample paths of the normalized and centered integrated periodogram 
(?r/m)°- 5 | J Ui a — EJ u ^a\ with p 0 = 0.05 for samples of size n = 2,000 from ARMA(1,1) and 
GARCH(1,1) models together with 95%-quantiles of the GRS both under the correct and under 
an incorrect null hypothesis. Due to the need of centering with EJ n ^A these sample paths are 
affected both by the sample and the model. Indeed, if the model is chosen incorrectly we will typ¬ 
ically subtract the incorrect centering and calculate an incorrect threshold a m . When using both 
the bootstrap-based or true 95%-quantiles of the GRS, the model is not rejected if the sample is in 
agreement with the null hypothesis. However, if the sample comes from a model whose parameters 
slightly deviate from the parameters of the null hypothesis the incorrect expected value EJ u a and 
wrong threshold a m change the sample path of the integrated periodogram in such a way that the 
bootstrap-based GRT rejects the null hypothesis while it does not reject the null if one uses the 
quantiles based on the null hypothesis. It is advantageous to show both 95%-quantiles: they deviate 
rather significantly, indicating that we chose an incorrect null model. 

In Figure [5] we consider a stochastic volatility model X t = UtZ t , where (at) is a log-normal 
stationary process independent of the iid f-distributed sequence ( Z t ). The a degrees of freedom of 
the t-distribution coincide with the index a of regular variation of ( X t ). The extremogram of this 
sequence vanishes at all positive lags. This fact is in agreement with the extremogram of an iid 
sequence but is in contrast to a GARCH(1,1) process. Choosing po = 0.05, we apply the GRS to a 
stochastic volatility sample of size n = 2, 000 under the incorrect null hypothesis of a GARCH(1,1) 

1 Throughout, to exploit the power of the Fast Fourier Transform, we use the Riemann sum approximations to 
the integrated periodograms. We do not indicate this fact in the notation. 
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model with tail index close to the chosen a. The test clearly rejects the null hypothesis. We also 
run a GRT for the stochastic volatility sample under the null hypothesis of an iid f-distributed 
sequence with a degrees of freedom. We use the approximation of the distribution of the GRS by 
the distribution of the supremum of a Brownian bridge; see Example 1181 Also in this case, the null 
is clearly rejected. 

In Figure [S] we deal with a time series (X t ) of 1,560 1-minute log-returns of Goldman Sachs 
stock from the period November 7-10, 2011. It has estimated tail index a ~ 3. Using standard 
software, we fitted a GARCH(1,1) model such that of = 0.019 + 0.1Xf_ 1 + 0.87of_ 1 . Hill and 
QQ plots of the residuals of this model indicate that the noise is well fitted by a t-distribution with 
(approximately) 4 degrees of freedom. The theoretical index of regular variation of this GARCH(1,1) 
model is a = 3.13; see Table 2 in [S]. We test the null hypothesis of a GARCH(1,1) model with the 
aforementioned parameters. This hypothesis is rejected. On the other hand, the GRT passes under 
the hypothesis of an iid sequence, where we choose a m as the 95% empirical quantile. This means 
that the extremes of this data set are more in agreement with an iid than with a GARCH structure. 
This is perhaps not surprising in view of a high frequency data return series while GARCH seems 
more suitable for fitting low frequency returns. 

A GARCH(1,1) model is often considered to give a good fit to daily log-returns of stock prices 
and foreign exchange (FX) rates. For example, such a judgement may be based on tests for zero 
autocorrelation of the residuals, their absolute values and squares. We did not find evidence of 
GARCH behavior in the extremes of three 5-year time series of daily Euro-USD FX rate log-returns: 
from 2002 to 2006 (before the financial crisis), from 2006 to 2010 (including the financial crisis), 
from 2009 to 2013 (after the financial crisis); see Figure [7] We choose different thresholds a m . When 
Po = 0.05 the null hypothesis of an iid sequence is accepted for 2002-2006 and 2009-2013, but not for 
2006-2010. The null hypothesis of a fitted GARCH process with of = 2.37 x 10~ 7 -|-0.1X t 2 _ 1 -|-0.8of_ 1 
and iid f-distributed noise with 4 degrees of freedom is also rejected by the GRT for 2006-2010. For 
this latter period, the stationarity assumption may be doubted. We repeat the GRTs for p 0 = 0.02 
in the periods 2002-2006 and 2009-2013. In the latter case the iid null hypothesis is still not rejected 
while it is rejected in the former case. The abrupt change of the behavior of the GRT may be due 
to the sample size (roughly 1,280 for each time series). For po = 0.02 one would use only 2% of the 
data for the calculation of the GRT. 

Our simulation study points at some of the problems one has to face when using goodness of 
fit tests based on the extremes of a time series. A major problem is the choice of the threshold 
a m . A data driven choice would be preferable but we do not have a theoretical answer to the 
problem. We propose to use graphical methods to compare the shapes of the extremogram and the 
integrated periodogram for different thresholds and to choose a sufficiently high threshold where the 
shapes stabilize. A message from the simulations is that the sample size n should not be too small. 
For example, the GRTs in Figure [7] with n « 1,280 give rather distinct answers when switching 
from po = 0.05 to po = 0.02. The sample extremogram and the integrated periodogram render 
meaningless for too high thresholds because most indicator functions of extreme events will be zero. 
The simulation study indicates that it is useful to exploit the true quantiles of the GRS (obtained 
by simulation from a model under the null hypothesis) as well as corresponding bootstrap-based 
quantile of the GRS. In particular, when the null hypothesis is incorrect the two 95% quantiles 
(say) will typically differ, pointing at the incorrect null hypothesis. We do not address the problem 
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Figure 3. Density of the normalized GRS (solid line) and its bootstrap approx¬ 
imation. The sample size is n = 2,000. and the thresholds a m are chosen 
such that po = P(X > a m ) = 0.10, 0.05, 0.03 corresponding to the first, sec¬ 
ond and third column. Top: The sample is drawn from the ARMA(1,1) process 
X t = 0.8JT t _i + 0.1Zt-i + Z t , where (Z t ) is iid t-distributed with a = 3 degrees of 
freedom. Bottom: The sample is drawn from the GARCH(1,1) process X t = <7tZ t , 
where of = 0.1 + 0.1Xf_ 1 + 0.84o’(_ 1 and (Z t ) is iid t-distributed with 4 degrees 
of freedom. In this case, the index of regular variation for (X t ) is a = 3.49; see 
Table 2 in Davis and Mikosch [9]. 


of goodness of fit tests in the case when the null hypothesis depends on estimated parameters; the 
asymptotic theory does not change under mild conditions on the convergence rates of the estimators. 


5. Proof of Lemma m 

Part 1. Recall the series representations of J n ,A{g) and Ja(< 7 ) from (11.41) and (11.51) . respectively. 
Then for every fixed k > 1, large n, 

k 

= (co(ff)[7A(0) -7 a(0)] +2^2c h (g) [ta(/i) - 7^(/i)]) 

h= 1 

n—1 oo 

+2 c h(g)[lA(h)-'y A {h)]-2Y c h{g)'yA{h) 

h=k-\-1 h—n 

= h{k) + I 2 (k) - I 3 . 


Jn,A{g) - J Ag) 
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Figure 4. Paths of the integrated periodogram (n/m)°' 5 | J U) a — EJ n ^\ with po = 
0.05 for samples of size n = 2,000. Top: We work under the null hypothesis of the 
ARMA(1,1) model X t = 0.8X t -i+0.3Z t -i + Z t , where (Z t ) is iid t-distributed with 
a = 3 degrees of freedom. Left: The sample is drawn from the null model. The 
lower and upper dotted lines y = 11.9 and y = 12.9 correspond to the bootstrap- 
based and true 95%-quantiles of the GRS, respectively. The null hypothesis would 
be accepted. Right: The sample is drawn from the ARMA(1,1) process X t = 
0.8A' t _! + 0.1 Z t _i + Z t with the same distribution for ( Z t ). The lower dotted line 
y = 6.84 is the bootstrap-based 95%-quantile of the GRS. Based on it, the test 
would reject the null. However, it would accept the null if one chose the 95%- 
quantile of the null model. Bottom: We work under the null hypothesis of the 
GARCH(1,1) process X t = a t Z t , where of = 10~ 7 + Q.\Xf_ l + O.Slof^ and ( Z t ) 
is iid f-distributed with 4 degrees of freedom. Left: The sample is chosen from the 
null model. The lower and upper dotted lines y = 6.4 and y = 8 correspond to the 
bootstrap-based and true 95%-quantiles of the GRS, respectively. The null would 
be accepted for both quantiles. Right: The sample is drawn from a GARCH(1,1) 
process with of = 10~ 7 + O.lAf^ + 0.84 (J^_ 1 and the same distribution of ( Z t ). 
The lower dotted line y = 7.4 is the bootstrap-based 95%-quantile of the GRS. 
The null would be rejected in this case while it would be accepted if one used the 
95%-quantile y = 8 based on the null hypothesis. 
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Figure 5. The sample of size n = 2,000 is drawn from a stochastic volatility 
process X t = a t Z t with log-volatility logo* = 0.91ogcr t _i + e t for an iid standard 
normal sequence (et), Zt is i-distributed with 3.6 degrees of freedom. Left: Sample 
path of (n/m)°' 5 \ J n ,A — EJ n A | with po = 0.05. The lower and upper dotted lines 
y = 7.8 and y = f0.2 correspond to the true and bootstrap-based 95%-quantiles 
of the GRS under the null hypothesis of a GARCH(1,1) process Xt = &tZt with 
of = 6.23 x 10 -3 + Q.lXi_ l + 0.8 ftf-i and iid t-distributed ( Z t ) with 4 degrees of 
freedom. This process has tail index 3.68; see Table 1 in [9] . The test clearly rejects 
the null hypothesis. Right: Sample path of the integrated periodogram absolute 
value n°' 5 \J n ,A — V’o7a( 0)|. The dotted line is the 95%-quantile of the distribution 
of the supremum of the absolute values of a Brownian bridge. The test clearly 
rejects the null hypothesis that (Xt) is iid. 


Then I 3 —> 0 as n —> 00 since ( 7 , 4 (h)) is summable and Elftk) converges to zero as n —> 00 due to 
regular variation, for every k. In view of (12.11) in (M), 


n— 1 

E E 7A(h)c h (g) 
h=r„+l 


< 


n — 1 

— E ( n - h ) °h(g) (Ph - pI) 

h=r n +1 

00 

cm £h —>• 0 , n —> oo , 

h=r n +1 


and (| 2 .zj) m (Mj 


r n 

lim limsup E > 7 A{h)ch{g) 

k—> OO 77—Voo ^' 

^ h=k+l 


T n 

< c lim lim sup m > Ph = 0 . 

k—> oo n-vnn ‘ ^ 

n ^°° h=k +1 


Since lim fc _>.oo J2h=k+i 7 a(K) = 0, we have lim^oo limsup^^ \EI 2 (k)\ = 0. This proves Part 1. 

Part 2. It follows from Theorem 3.1 in Davis and Mikosch [7] that "fA(h) —> 7 a(E), h > 1. Hence 
L 2 

h(k) —► 0 as n —> 00 for fixed k > 1. It remains to show that limfc_>oo lim sup,^^ 'wsx(I 2 (k)) = 0. 
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Figure 6. GRTs for 1,560 Goldman Sachs 1-minute log-returns. Left: The inte¬ 
grated periodogram (n/m) 0,5 | J H} a — EJ h ,a\ withpo = 0.05 under the null hypothe¬ 
sis that the data are generated by the GARCH(1,1) model of = 0.019 + 0.1Xf_ 1 + 
0.87of_ 1 with iid t-distributed noise with 4 degrees of freedom. The lower and up¬ 
per dotted lines y = 7.6 and y = 12.3 represent the true and bootstrap-based 95%- 
quantiles of the GRS under the null hypothesis. The hypothesis of GARCH(1,1) 
is clearly rejected. Right: The integrated periodogram n 0 5 \J n ^A — V’o7a( 0)| with 
Po = 0.05 under the null hypothesis of an iid sequence. The dotted line repre¬ 
sents the asymptotic 95%-quantile based on the approximation of the GRS by the 
supremum of the absolute values of a Brownian bridge. The null hypothesis is not 
rejected. 


We have 


r n n— 1 

h{k) = 2( £ + ]T ) c h(9)[lA(h)- lA (h)\ =2/ 21 (fc) + 2J 22 . 

h=k-\-l h—r n -\-1 

In view of Lemma Q] we get the bound 


r n r n —h 

var(/ 2 i(fc)) < — Y \ c h(g)ch+i{g)\ X 

h=k-\-l 1 =0 

n—h—l n—h 
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Since \ch(g)\ < c/h (see (12.171) 1. 
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FIGURE 7. CRTs for daily Euro-USD FX rate log-returns 2002-2006(top, n = 1,280), 
2006-2010 (middle, n = 1,279), 2009-2013 (bottom, n = 1,281). The graphs show the 
integrated periodograms n°' 5 | J n ,A — ^07^(0)! under the null hypothesis of an iid sequence 
and (n/m) 0,5 | J n ,A—EJ„, a\ in the case of a fitted GARCH model. Under the iid hypothesis, 
the dotted lines represent the 95%-quantile obtained from the limiting supremum of the 
absolute values of a Brownian bridge. Under the GARCH hypothesis, the dotted line 
represents the bootstrap-based 95%-quantile of the GRS. Top: FX rate log returns 2002- 
2006 (n = 1, 280). We test under the iid null hypothesis. For po = 0.05 (left), the null is not 
rejected. This is in contrast to the case po = 0.02 (right) which leads to a clear rejection. 
The qualitative difference may be due to the relatively small sample size which renders 
the test statistics meaningless. Middle: FX rate log returns 2006-2010 (n = 1, 279). Left. 
The iid null hypothesis with po = 0.05 is rejected. Right. A GARCH(1,1) model with 
<7? = 2.37 x 10~ 7 + 0.1A' t 2 _! -t-0.8<7t_i and iid t-distributed noise with 4 degrees of freedom 
is fitted to the data. The null hypothesis of this GARCH is clearly rejected. Bottom: 
FX rate log returns 2009-2013 (n = 1, 281). The iid null hypothesis with po = 0.05 (left) 
and po = 0.02 (right) is not rejected. 
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and the right-hand side converges to 0 by first letting n —> oo and then k —> oo, using (12. 2 [) . Since 
the structures of Q 2 and Q 3 are similar we restrict ourselves to showing Q 2 —> 0 as n -> 00 , k — > 00 . 
We observe that 


r n ^ 2 r n 


? t + S ) 


h=k -\-1 s=/i 


1^1 ^ w E EJwm, 

n 

55 & + 


. m log r n 
< c- m 


t =1 t=2r n + l 
^2 , 


E ralog r n 

P/i + c- rn 

71 . 


cn 1 1 m 


h=k +1 


/i=r n + l 


55 p' 1 / 71 ) 


h=fc+l 


In the last step, we used (lot . The right-hand side vanishes as n — > 00 and k —> 00 . Finally, we 
conclude that lim*,-^ limsup^^^ var(/ 2 i(fc)) = 0 . 

Now we turn to bounding var(/ 22 )- In view of Lemma [1] we have 


var(/ 22 ) < 


We have by (12.171) . 


n— 1 n—1 


t=l 


— 55 X] l C/l ( 5 ) Cs ( ff )l(l r (°’ M,s)| + 55 + S )l 
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n—h 

+ ^ ^ |r(0, S, £, t + /l)|^ = Q 4 + Q 5 + Qq . 


2 71—1 71— 1 
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< C 


m 


-rn 
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5Z & 


{pom) 2 


= o(l), n —> 00 . 


h=r n - 1-1 

The terms Q 5 and Q 6 can be treated in a similar way; we focus on Q 5 . By (12.171) . 


2 7i—l h-\-r n r n 
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Next we consider Q 52 and Q 53 . By (12.31) . we have 

2 n— 1 n— 1 n 


Qb2 < C 


2 m 2 


E Em - 1 E E f<- 


/i=r n + l t=r„ + l t=r„ + l 

The right-hand side converges to zero by using the assumption mlog 2 n/n = 0(1) and the condition 
(ED- Similarly, using (12.31) . we obtain 

OO 

m 

O 53 < c—m } £ h . 

r> z. —' 


^=^n + l 


We conclude that var(/ 2 2 ) —► 0 as n —> 00 . 

We proved above that E{J n , A — Ja (<7)) 2 —> 0 , hence J n , A (g) -> J A (g), combined with (12.71) . yields 
J°n,A (9) ^ J%(g). 


6. Proof of Theorem fl5l 

We start by proving m ■ An application of the continuous mapping theorem in C(II) and 
Lemma |4] yield in C(II) for every k > 1, 

fc k 

( —)°' 5 (V’o ( 7 a( 0 ) - A 7 a( 0 )) + 2 Y ip h ( 7 a(A) - Ey A (h))) 4 ^Z 0 + 2 ^ . 

n h =1 h=i 

Here (Zff) is a mean zero Gaussian process with covariance structure specified in LemmaUJ In view 
of Theorem 2 in Dehling et al. m relation (13.31) will follow if we can prove the following result. 


Lemma 23. Assume that the conditions of Theorem ] 1 5\ hold. Then for any s > 0, 

n —1 

lim limsupP((n/m ) 0 - 5 sup I V' ip h (X) (j A (h) - EPj A {h)) 

fc^oo n —>00 V Aen h=k+l 



Proof of Lemma WtA We borrow the techniques of the proof of Theorem 3.2 in Kluppelberg and 
Mikosch m ■ Without loss of generality we assume that k = 2 a — 1 and n = 2 b+1 where a < b are 
integers; if k or n do not have this representation we have to modify the proof slightly but we omit 
details. For integer q > 0 and some constant k > 0 to be chosen later, let e q = We have for 

£ > 0 , 


n—i 

Q = p((n/m) 05 sup I Y (fy A {h) - Ei A (h)) V>k(A)| > s) 

b 29+l_i 
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b b 2 q+1 -l 

Y £ i > £ ) + P ( U {( n / m )° 5 SU P | (7A( h ) ~ E^ A (h))ip h (\)\ > £ q }^) 

q=a q=a A£ll h = 2 Q 

b 2 « +1 -l b 
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< P 


< P 


In the last steps we used that P(Y^ b q = a £( i > £ ) vanishes for fixed e and sufficiently large a. Next 
we will bound the expressions Q q . Write J q>v = {(u — 1)2 9 + 1,... ,v2 g } and for j e J qv and 
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AG [ 0 , 2 -2 %], 


2’ +1 -l 


Y qj ( A) = (n/m) 0 - 5 ^ (7 aQi) - E'y A (h))ip h {X + (j ~ 1 )tt 2 2q ). 
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We will bound each of the terms by twice applying the maximal inequality of Theorem 10.2 in 
Billingsley pQ. For this reason we have to control the variance of the increments of the process Y q j 
both as a function of A and j. In particular, we will derive the following bound 

25+1-1 2 

(6-1) ^ E ( E (7a(/i) -Ey A (h))d h (ui,X,j,j')^ < c\j - j'\ 2 \\ - uj\ 2P K k:n , 


where /? is the Holder coefficient of the function g , 

Kk.n E C 


m E + m ^2 Ph+ Tn/m 

h=r n -\~ 1 h=k -\-1 


and for j < j' in J q , v , h G {2 9 ,..., 2 9+1 — 1} and w < A in [0,2 2 g+ 1 7 r], 
( 6 . 2 ) d h (u,X,j,f) 

= (V>fc(A + ( j' - 1 )tt 2 ~ 29+1 ) - ip h (A + (j - 1)7 t2 _2,3+1 )) 
~(iph(u + ( j' - 1)tt2 _29+1 ) - ip h (w + ( j - 1)7t2 _2?+1 )) 


r*+U'-l)ir2- 2q+1 


j+(/ -l)TT2~ 2q+1 


I q(x) cos(hx)dx — I q(x) cos(hx)dx 

I A+(j —1) tt 2- 2 «+ 1 7 w +0'-1) tt 2- 2 '!+ 1 

/ .(j , -l)T72 -2 «+ 1 

(g(x + A)[cos(/i(x + A)) — cos(h(x + w))] 


I (j— 1)7t2 -2 9+ 1 


Since g is /3-Holder continuous we have 

. /•0'-l)7r2 -2 «+ 1 

I Ji 


— \g(x + A) — <?(x + w)] cos (h(x + uj))j dx. 

3 have 

[t/(a; -(- A) — g(x + w)] cos(/i(u; + x))dx| < c(A — w)^(j' — j)‘2~ 2q . 


Similarly, 


/ (j — I)7r2“ 2 5+ 1 

rW-l)n 2 ~ 2q 

/ g{x + A)[cos(/i(A + x)) — cos (/i(w + x))]dx 

/(j-1)tt2- 2 ® 

g(x + A)(2sin(/i(A — w)/2) sin(/i(A + w + 2x)/2))dx 

'0'-1)7t2- 2 « 

< c/i(A - w)(j' - j)2 _2? < c(A - w)(/ - j)2~ q . 










28 


T. MIKOSCH AND Y. ZHAO 


The last two inequalities yield for a constant c only depending on g , 
(6-3) \d h (u,\,j,j')\ < c|A — ui\P\j' - j\2~ q . 


Using this bound, we have 
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In what follows, it will be convenient to write Yh\ = 21 1 Xw=o h 1 • I 11 view of LemmaUwe 

can bound the last term in (16.41) as follows: 
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We will treat two cases of interest for the sums Yifi '■ when 2 q+1 — 1 < r n and 2 q > r n . If 

2 q < r n < 2 q+1 — 1 the sums Yiu can be split into two sums corresponding to h <r n and h > r n 
and these can be treated in a similar fashion. 

We start by studying the case 2 q+1 — 1 < r n . Then r n > 2 q+1 — l>h>2 q >k and consequently 
2 q+1 — h — 1 < 2 q . Thus, W\ < c2 q mYh=k+iP h • The terms 14 2 , W 3 have a similar structure and 
can be treated in the same way; we focus on W 2 . Then we get the following bound from Lemma |T] 
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In view of (12.411 . we also have 
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We again focus on lUu W 3 can be treated in a similar way. 
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To obtain the bounds for W 4 we use (IMD : 
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Collecting the bounds for IT,;, i < 4, and using (16.41) . we finally proved (HTTP . 

Using this bound, we can apply the maximal inequality of Theorem 10.2 in Billingsley [T with 
respect to the variable A < 2” 2l? 7r and for fixed j,j': 

P{ max |Uj(A) - Y,/(A)| > e q ) < ce“ 2 (2“ 2 %) 2/3 (j - j 1 ) 2 K k>n 


0<A<2- 2 «7r 
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Another application of this maximal inequality to maxQ<^< 2 - 2 S j. |Y)(A)| with respect to the variable 
j £ Jq,v yields 


Qqv = Py 
Then we also have 


max 

j£{(v-l)2 q +l,...,v2 q } 0 <A< 2 - 2 « 7 r 


2 q 


max |h^(A)| > £g\ < c2 4?(2 1 /3+K 1 ' ) K k , n ■ 
\< 2 ~ 2q TT J V 


Qq < ^ c 2 4 «( 3 / 4 -^ +k “ >K k , n . 


V = 1 

The right-hand side converges to zero as q —> oo provided f3 € (3/4,1] and n is chosen sufficiently 
large. Therefore we conclude for every e > 0, 

b oo 

( 6 . 5 ) Q < Y, Qq < cKk,n J2 2 49 ( 3 / 4 -^ +k_1 ) . 

q—a q—a 

The right-hand side converges to zero by first letting n —> oo and then k — > oo. This concludes the 
proof of ([iOp. 

Next we turn to the proof of (13.41) . It will follow from (13.31) once we prove the following lemma. 
Lemma 24. Assume that the conditions of Theorem 1 1 5\ hold. Then for any £ > 0, as n -A oo, 
P((n/m) 0 - 5 sup | (J„,a(A) - EJ n , A (X)) - (J„,a(A) - EJ nA (Xj) | > e) -a 0. 

v Aen ' 

Proof of Lemma \2/\ For any fixed k > 1 we have 

P 


((n/m) 0 - 5 sup |(J„,a(A) - EJ n<A { A)) - (J„,a(A) - EJ n , A ( A)) | > e) 
v Aen J 

k 

< P((n/m) 0 - 5 suply^ fi A (h) - Ej A (h)) (if h (\)-{jj h (\)) > e/3 

V Aen 1 h =0 

n 

+p((n/m) 0 - 5 sup | ^2 (lA(h) - E^ A (h))fj h (X) > e/3^ 

Aen h=k +1 
n 

((n/m) 0 5 sup I y2 (jA(h) - E^ A (h))^ h (X) > e/3) 

A Aen 1 . 


+P 


h=k -\-1 


= Vr + Vi+Vz. 

An application of Chebyshev’s and Holder’s inequalities yields, 

k 

Vi < 9e ~ 2 — E sup I y2 {lA(h) - E^ A (h)) (iph(X) - i>h( A)) 
m Aenl ^o 

k k 

< C — E sup V' (t A(h) - ^7A(/i)) 2 |'0/i(A) - Vto(A)I V" IV’s(A) - V>«(A)| 
m \ g t\ z —' 1 1 1 1 


s=0 


< ck— y^ var('y A (ti)) sup |^h(®) - $h(x )I • 

m ' --tt 1 1 


h —0 


men 


Next we will study sup Agn ^(A) — ^(A)|. Trivially, for itn, 

[X 

/ cos(hX) g(X) dX < c/n , 

J UJ-n.(Xn) 
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where the constant c only depends on g. We also have for the frequencies x £ II, 


\-lph{uJn{x„)) - 1ph(t0n(Xn))\ 
CUn(i) 


/ rWnW \ I 

> ( / cos(hX) g(X)d\-u} n (l)cos(hLOn(i)) 

1 ) ' 


( 6 . 6 ) 


< El 


rwn(i) 


i= 1 ^ 


(i-1) 


cos(/iA) (g(X) — g(ui n (i))) dX\ 


, Iv' , f sin(huin(i)) - sin(/icj„(* - 1)) . . . 

+ | 2 _g(un{i))y ---—-T— 1 ---— - ta„(l) cos(/iw ri (i)) J | . 

i=l 

(6.7) 

Since g is /3-Holder continuous there exists a constant c > 0 such that 

|#(A) - g(u n (i))\ < cn~P , A £ [u> n (i - 1), w„(*)]. 

Therefore the term in (16.61) is bounded by cn _/3 . A Taylor expansion as £ —> 0 yields sin(z) = 
z — z 3 /3\ + o(z 3 ). Then we have for h < n, 

I sin(/iaJrt(i)) — sin(huJn(i — 1)) /1N ,, 

|---<v„(l) cos(ftu rl (*))| 

= |2 hT 1 sin(/iu;„(0.5)) cos (hd(i -(- 0.5)) — w»(l) cos(/iw TI (j))| 

= j2/i _1 (sin(/ia; Tl (0.5)) — hu„(0.5)) cos (h9(i + 0.5)) 

+ain(l)(cos(/ia;„(i + 0.5)) — cos(/iw n (i)))j 

< c(hoj„(l)) 3 + £j„(l) 12 sin(/iu>n(0.25) sin(/ia;n(i + 0.25))I < c ( h 3 n ~ 3 + hn ~ 2 ) . 


Consequently, we have the bound c(k/n)( 1 + k 2 /n) for (16.71) uniformly for x £ n and h < k, Thus, 
uniformly for h < k, 


sup | ijj h (x) - iph{x)\ < c[n 13 + {k/n)(l + k 2 /n)\ . 
xeh 


As we have shown in Lemma 0 ( n/m ) XEo var ( 7 A(^)) < cfc; see also Davis and Mikosch IT], 
Lemma 5.2. Thus, asn-> oo, 

Vi < c[k 2 n~P + (fc 3 /n)( 1 + k 2 /n )] -► 0 . 

It follows from Lemma [23] that lim^oo lim sup ra _>, 00 V 2 = 0. We adapt the proof of Lemma [23] for 
the case V 3 . Abusing notation, consider 

d h (uj,X,j,j') = (VVj(A + (j' — I)7r2 _29+1 ) — ip h (X + (j — 1)7t2 _29+1 )) 

-(^(w + (/ - 1 )tt2 -29+1 ) - $ h (w + (j - 1)tt2 _29+1 )) . 

Recall that we assume n = 2 b for some integer b and x n = [nx/(27r)]. Therefore for A £ n and 
integer j, 

= [nA/(27 t) + (j - l)2- 2 « +b ) 

= [n\/( 2 n)} + (.j - l) 2 - 2?+b 

= A n + (j — l)2 -29+b . 


(A + {j — 1)tt 2— 2qr+1 ) 
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Thus we can write 


2 Xn+a'-l)2 b ~ 2g 

= — y g(LJn(i)) cos(hu>„(i)) 

i=Xn + U-lp b - 2 1 
T.+W-l)2 b ~ 2 1 

y, g(uJn(i)) COs(/lWn(i)) 

i=w„+(j —1)2 6 - 2 9 
2?r (/- 1 ) 2 6 “ 2 0 

— y yg{u n (\n + i))[cos(/ica n (A„ + i)) - cos(huj n (u} n + i))] 


2 tt 

n 


i=(j-l)2 b ~ 2 1 


-[g(u)n(\n + 1 )) — g(uj n (ujn + *))] COs(huJn(u}n + *))) = T\ + I 2 . 


Calculation yields 


\Ti | 

^ cw n (A n ) Ct) n (u) n ) 11 (J 

- j)2 2q \2 q < c (A„ - w n )/n (j 

- j) 2 ~ 2q \: 

\T*\ 

^ c|u)t7,(At7,) bJn iyin ) | ^ | (j 

' - j)2~ 2q \ < c (A n - w n )/n ^ (. 

I'-j) 2 ~ 2q \ 


Combining these bounds, we have, 


\dh (w, \j,j')\ < c\(\n - Un)/nf\(j' - j)2 2q \2 q . 


In the remaining argument we can follow the proof of Lemma 1231 the only difference is that we have 
to replace the supremum over A, w € [ 0 , j 2 ~ 2q+1 ] by the corresponding quantities A n /n,u} n /n € 
[0, j2~ 2q+1 ]. This proves 

lim/c^oo lim sup,^^ V 3 = 0 and concludes the proof of the lemma. 

The proofs of (13.611 and (13.71) are completely analogous. Instead of the relations (12.81) one has to 
use (12.101) . 


7. Proof of Theorem m 

We adapt the proof of Theorem [15] We need to prove that 


(9) 

ny |cov(7a(/i),7a(/i + 0)1 < c2? . 
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where E/f; is defined in the proof of Lemma l23l Here h 


> V- 


(?) 


n'^2\cov('y A (h),'yA(h + l))\ 


2 (<?) n — h—l — 1 

= — ’52\{n-h-l)T(0,h,0,h + l)+ Y (n-h-l-t)T(0,h,t,t +h + l) 

h,l t= 1 

n — h — 1 

+ min(n — h — l, n — h — t)r(0, h + l, t, t + fr)| 

t=i 

2 1 + 1 ~i 2 ’+ 1 - 12 ’+ 1 -/i -1 

< m 2 J2 |r(0,0, h, fe)| + m 2 Y E \T(0,0,h,h + l)\ 

h=2<l h=2<i 1=1 

(q) n — h — l — 1 (<?) n — h — l — 1 

+m 2 E E \T(0,h,t,t + h + l)\ + m 'y ^ ' | r (0, h + l, t, t + h)\ 

h,l t= 1 h,l t=1 

2 q+1 -l 2 q+1 ~l 7] 

= m 2 J2 |r(0,0,/i,/i)| +m 2 Y X;i r (°,M,ft + OI 

fe=29 ?i=2<2 2=1 

2 <J+1 -1 7) 7) 2 < >+ 1 -l 7; 7; 

+m 2 E EE |r( 0 , h, t,t + h + Z)| + m 2 E EEipo^+^+^i 


2t=29 2=1 t=l 


21=29 2=1 t= 1 


< c2 9 


In the above calculation, we use the facts that for s < t < u < v, r(s, t, u,v) = 0 where t — s > r/ 
or v — u > r). 

In the remaining argument we can follow the proof of Theorem 1151 instead of Lemma U we use 
the central limit theory of Lemma [G] □ 

8. Proof of Theorem ED 

We will mimic the proof of Theorem [15] We start by proving a result for the bootstrapped sample 
extremogram j A analogous to Theorem 1201 

Lemma 25. Under the conditions and with the notation of Theorem, ] 2(A for h > 0, 
d((n/m)°' 5 ( 7 i(i) - 4 0 , n -> oo . 

Proof. We start by observing (see Lemma liTTl) that for h > 0 

777 

E* 7l(/i) = —(n-h)E*h.h. +h 


= (1 -h/n) 7 A(h) + - E Itlt+h 

n z —' 


E*r A (h) = -{n-h)E*h*I {1+h) . 


= (1 - h/n) (1 - Of 7 Ah) + - V T t I t+h 

n 

t=n-h-\-1 

where we interpret indices larger than n modulo n, and therefore 

(8.1) (n/m) 0 ' 5 [(1 - 9) h E*j* A (h) - £*%(&)] = Op^” 1 ) 4 0 , 
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_ 2 

where we used that I n — p 2 = Op(\/yfmn). By virtue of Theorem [27)1 it suffices to show that for 
any e > 0 and h > 0 , as n —> oo, 


P 


((n/m)°' 5 |(l - e) h (j* A (h) - E*r A (h)) - (? A {h) - E*? A (h )) 


> e) -4 0 . 


Markov’s inequality ensures that it suffices to prove that 


—var*((l — d) h "/ A (h) — 7^4 (ft)) -4-0, n — > oo . 

We observe that 

^var*((l - e) h ^* A (h) -7aW) 

= m( 1 - ^)var* (?i*?(i+^)* - (1 - 0) h li*h*+h} 

n—h—1 , 

+2m ]T (1-x 

S = 1 

cov* (ji — (1 — d) h I\-h- + h, 7(i + ,)./(i + . +fc ). — (1 — 6 l ) h /(i+ s )*/(i+ s )*+/ l ^ 
= rn(l - ^-)var* ^/i*/(i+h)* - (1 - 6) h I 1 *I 1 - +h ^ 

n — h — 1 

+2m ^ (1-) cov*(7i*7(i +h) .,J ( i +s) .7 ( i +s+h) .) 

s =i n L 

—(1 — 0) ,t cov*(Ii*/( 1+ , l ).,/( 1+3 )»7( 1+s )» +h ) 

— (1 — 6 , ) h cov*(/i*/i. + j l ,/( 1+s )./( 1+s+h ).) 

+(1 — d) 2h cov (7i»/i* + k,/(i_|_ s )»/(i_|_ s )» + f l )j = Qi + Q 2 ■ 


We will show that the right-hand side converges to zero in P-probability, where we focus on Q 2 and 
omit the details for Q 1 . We start by looking at the summands in Q 2 for fixed s < h, using the 
structure of the covariances in Lemma [571 The expressions for the covariances in Lemma 1571 contain 
terms with normalization n~ 2 . For example, by (18.71) a corresponding term in Q 2 is of the order 


n 2 n 2 

i(n _1 ^ hh+h) = TO ~ 1 (~ y^Jjlj+h) =Op(m _1 ), 


2=1 


since — ]P " =1 hh+h —> 7 a (ft); see Lemma 2] In the latter sums, the 7j’s can be exchanged by 
the 7i’s or the /^’s. Therefore all other terms in Q 2 with normalization mn -2 converge to zero in 
P-probability. Another appeal to Lemma [57] shows that it remains to consider those expressions in 
Q 2 that are normalized by mn~ l again for fixed s < h. From (18.91) and (18.101) we see that, on one 
hand, we have to deal with the differences 

n n 

(8.2) (1 - ey +h — V TiTi+aii+hZ+s+h - (1 - ey +2h - V iJ i+h T i+s T i+3+h , 

n z —' n z ' 

1 = 1 1=1 

but both sums are consistent estimators of hin^^oo mP(a“ 1 A 0 £ A, £ A, ay^Xh £ A, ay^Xg+h £ 

A) (see [7], Theorem 3.1). Therefore (18.21) converges to zero in P-probability. On the other hand, 
in view of (18.71) and ([8.81) we have to deal with the differences, for s < h 7 


( 1 -9)s+ 2 h - 
n 


J2iiii+ s ii+hii+s+h-( i-ef h 

i =1 


m 

n 


n 

i=l 


which again converge to zero in P-probability. These arguments finish the proof for s < h. 
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An inspection of the covariances in Lemma [27] shows that for s > h all expressions with nor¬ 
malization nV 2 do not depend on s. The corresponding aggregated terms in Q 2 are then given 

by 


2 TO 


s=h+l i=1 

n n 

+(1 -ey +h (V 1 Y tli+h) ( n - 1 Y lA+h) ) 

i= 1 i= 1 

n n n „ 

+(i - ey +2h ( 'n - 1 Y Tdi+h) (n _1 Y ZZ+ h ) - (i - oy +2h (n -1 Y ZZ + h ) ] 

i=1 i =1 i= 1 

«.«) "E‘ (i - a ■-»)‘ + ‘ 


= —2 TO 


s=h +1 
t .—h — 1 




\s-\-2h 


s=h-\-1 


= Op(l/(9\/mn)) = op(l). 

In the last step we used (18.11) and the assumption nO 2 /m —> oo. Finally, we deal with the remaining 


terms in Q 2 ■ In view of Lemma [23 they are given by 

n—h—1 , 

h + S 

n 


2 m 


Y (* - ——) [(i - e Y +h ^ Y TiTi+sZ+hh+s+h 

' ‘ i= 1 

n 

-(i - ey +h n - 1 Y iJi+hii+Ji+s+h 

i=1 

n n 

-(i - ey +2h n - 1 YiJi+hZ+sZ+s+h + (i - ey +2h n - 1 YZiZ+sZ+hZ+s+h\ 

i =1 i= 1 

n—h—1 , n 

= 2m ]T (l - -jp) (! - 0)' +h n _1 1] Zj i+h (Z+sZ+s+h ~ Z+sZ+s+h) 


s=h -\-1 
n —h — 1 


+ 2m (1 - —I—) (1 - 6 ) s+2h n- 1 Y lili+h (. h+Ji+s+h ~ Ii+Ji+s+h.) = Jo ■ 


i= 1 
r 

s+2h -1 

s=h -\-1 

Using the assumption nd 2 jm —> oo, we have 

n—h—1 


E\J 0 \ < cm Y (l-0) s+h E\I O I h -IoI h \ 


s—h -\-1 


n— h— 1 


< cmE\p 0 — I n \ Yj (1 — 9) s+h < c(m/n) 05 9 1 = o(l). 

s=h-\-1 

This finishes the proof of the lemma. □ 


□ 


We conclude from Lemma [25] that for any k > 1, as n —> oo, 

k 

d((n/m) 0 ' 5 (Vo (%(0) - U* 7 l( 0 )) + 2 Y ^ (7aW ~ £*%(&))) , 

h= 1 
k 

ipo Zq + 2 y ^ i/jh Zh) —y 0 , 

h=1 
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where the dependence structure of ( Zh ) is defined in Lemma [4] 

The proof of the theorem is finished by the following result which parallels Lemma [23] 

Lemma 26. Assume the conditions of Theorem, \21\ Then the following relation holds for 5 > 0 

n— 1 

lim limsup p((n/m ) 0 ' 5 sup I V] ip h ( A) (j* A {h) - E*^* A (hj) 
k^oo „_►» V Aen h=k+1 

(8.3) 

Proof. We follow the lines of the proof of Lemma [23] and use the same notation. We again assume 
without loss of generality that k = 2 a — 1 and n = 2 b+1 for integers a < b, a chosen sufficiently 
large, and we write e q = 2 _29 / K for re > 0 to be chosen later. Then, for large a depending on e > 0, 
the steps of the proof lead to the inequality (cf. (16.5m 



n— i 

Q* = P* ({n/m ) 0 ' 5 sup I £ {r A {h)-E*r A {h))MX) > e) 

v Aen 1 - J 


h=k -\-1 


< c^ 2 4 «( 0 - 75 -^ _1 )^, 


where /? € (3/4,1] is the Holder coefficient of the function g , the number n > 0 can be chosen 
arbitrarily large and 


K q 


2«+ 1 -l 2 q+1 -l 

z: J2 J2 |cov*(%(h),%( s )|. 

h =29 s=h 


By the Cauchy-Schwarz inequality, for s,h £ [2 9 , 2 9+1 ) and h < s, 


(n/m) 2 |cov*(%(/i),%(s)| 2 < {n/m)vaT*(fy A (h)) {n/m)vai*{^* A (s)). 


We will show that 

(8.4) ( n/m)Evar*('j A (h )) < c 


for some constant c, uniformly for k < h < n and n. Then 


EQ* <cJ2 2 4 « (3/4 “ /3+k 1} < c 2 4 « (3/4 “ /3+k 1} . 

q=a q—a 


The right-hand side converges since /3 S (3/4,1] and k can be chosen arbitrarily large. Moreover, 
the right-hand side converges to zero as k —> oo. 
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Thus it remains to show (18.41) . In view of Lemma \27\ we have 
(n/m)Eva.r*(%(h)) 

= (m/n)\(n— h)Evar*(h*T( 1+h y) 


n—n— 1 

+2 Y (Ti-h-t)Scov*(7i.7(i + / l ).,7(i +t ).7(i +t+ / 1 ).)] 

t= 1 

n ^ 

[m( 1 - h/n){ 1 - d) 2h ^E{hT 1+h ) 2 - E^rT 1 Y Iih +h ) ] ] 

i= 1 

n—h—1 n 

+2 m (1 ~ (h + t)/n) [n -1 Eljlj+hlj+tlj+t+h] (1 - Of 

t =1 i=l 

min(/i — l,n — h— 1 ) 77 , ^ 

+2m ^ (1 -(h + t)/n)E(n- 1 J2l i Ti+t) {(1 - d) 2t - (1 - 0) t+h ) 


\t-\-h 


t=1 

min(h—l,n—h—1) 


—2m 


< 


Y (1 -(h + Q/^E^Yhli+h) (l- 9 ) 2h 

t= 1 i= 1 

n—h—1 n 2 

-2m Y (1- (h + ^/njE^Yhli+h) (1 - 9) t+h 

t=h i= 1 

n—h—1 n 

mE(Jih +h ) 2 + 2m Y (1 ~ (h + t)/n) ( n -1 Y. E h li+hli+tli+t+h^jiX 0) 


t+h 


min(/i — l,n—h — 1) 


+2m Y^ (1 — (h + t)/n)E(n 1 lili+t'j (l $) 

t= 1 i=l 

= V1+V2 + V3. 

We observe that, for some constant Co > 0, 

V\ < mE(IiIi +h ) 2 < cm \EI\I\ + h + ( EI n ) 2 j < cmpo < Co . 

For V- 2 , we observe that for i <n, 

771 $ ^E^Iili+hli+tli+t+h hh+hh+t.Ii+t+h\ | 

< cmO~ 1 E\l n — po\ = 0(y/m/nd- 1 ) = o(l), 

by virtue of the condition n0 2 /m —> oo. Therefore, for showing that IV 2 I < c uniformly for h,n, it 
suffices to show that |V 2 1 < c, where V 2 is obtained from V 2 by replacing the It’s by the corresponding 
It’s. Taking into account Elili +t = Pt~Po and the Cauchy-Schwarz inequality, we have for a fixed 
integer M > 0, 

n—h—1 n 


| V 21 < cm E b _1 E 

t=1 z=l 

n—h—1 

Y \EIi Il+hh+tll+t+h\ 


= cm 


t =1 


< (mpo)M + cm E (Pi+Po) + CTO Ct < c i 

t=M +1 t=r n -\-1 
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in view of condition (M) and regular variation. A similar argument as for V 2 shows that one may 
replace the It’s in V3 by the corresponding It s. We denote the resulting quantity by V3. Then we 
have 


n n—t n ^ 

V 3 < m^(l-6»)‘£;(n- 1 ^7 i 7 i+t +n- 1 ]T 77+t-n) 

t =1 i= 1 i=n —1+1 

n n — t 2 71 n 2 

< cm^(l-0) t A(n" 1 ^77+t) TJi+t-n) 

t =1 i= 1 t= 1 i=n— t+1 

= V 31 + V 32 . 


We will only deal with V31, the other term can be bounded in a similar way. We observe that for 
fixed M > 1, using condition (M), 


V31 


< 


< 


< 


n n — t — 1 

c—Y^ii-ey^Eiiih+t) 2 +2 \Eij 1+ ji + sTi+s+t\) 

n t= 1 S=1 


n n—t — 1 

o(l)+ c-£(1-0)* £ \ElJ 1+t I 1+s I 1+s+t \ 

t= 1 s =1 

n r n n 

°(!) + c ^£ (1 - fl )‘ £ (p s +Po) + c^^(l-0) t ]T 

t=l s=M+l t= 1 r n + l<s<n—t — l,s<t 

n 

+c^^(t- 0 ) i ^ (|^7Ji4*7i + ./i + . +t -(pt-rf) a n-(pt-pg) a ). 

t=l r n -\-l<s<n— t — l,s>t 


In view of condition (M), the first two terms on the right-hand side are negligible as n —> 00 . The 
third term is bounded by 


n n 

£ &_ t + cm^(l- Ofipt-pl ) 2 . 

t =1 r n + l<s<n— t—l,s>t t —1 


Multiple use of (M) again shows that the right-hand side is negligible. This proves (18.411 . □ □ 
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Lemma 27. 


Under the conditions of Theorem \21\ the following relations hold for s, h > 0 


0 


(8.5) 

( 8 . 6 ) 

(8.7) 

( 8 . 8 ) 

(8.9) 

( 8 . 10 ) 


E*h> = 0, 

n n 

E*Ti*I( 1+h) * = (1 - 9) h n- 1 Y IJi+h , E*h,h, +h = n- 1 Y EE+h , 

i= 1 i= 1 

cov*(7i*/i* + / l , 7( 1+s )./(i +s ). +ft ,) 

n n 2 

= (i - ey (n- 1 Y uii+sh+Ji+s+h -{y-^Y TiU+h) ), 

i= 1 i= 1 

cov* (7i*7( 1+fc j., 7( 1+s )»7( 1+s j. +h ) 

n n n 

= (1 - 0) max(s ’ fe) (V 1 ^ IJi+Ji+Ji+s+h -{n^Y lili+h) [n- 1 Y EE+h) ) 

2 = 1 2=1 2=1 

cov* (E*E*+h, 7( 1+s ).7( 1+s+h ).) 

n n n 

= (1 -ey +h (n-'YTiTi+hZ+sE+s+h- (n- 1 ^ JiJi+h) , 

2=1 2=1 2=1 

cov* (7i* 7( 1+h )., 7 (1+s )» 7( 1+s+h ).) 

' (1 - ey+ h [nT 1 E ”=1 UE +s E+hE+s+h ~ [n- 1 E " = 1 7)7 i+s ) 2 ] + 

, (1 - ey +h (n- 1 £" = 1 ££+.£+*£+.+* - (V 1 £? =1 ££+fc) 2 ) , a > h . 


Proof. Relations (18.51) and (18.61) follow from the defining properties of the stationary bootstrap; see 
Politis and Romano [23l . 

We will only show that (18.101) holds; (18.71) (18.91) can be proved in a similar (and even simpler) way 
but we omit further details. First assume s < h. Recall L\ from the construction of the stationary 
bootstrap scheme. Consider the following decomposition 


E* [7i*/(i+/i)*-f(i+s)*-f(i+s+h)*] 

= E*[Ii*I(i + hyI(i+ S yI(i+s+h)* | L\ < s] P(Li < s ) 

+E*[Ii*I(i + hyI(i+s)* I(i+ s +h)* | s < L\ < h) P(s < Li < h) 

+E*[Ii* J(i + /j)»7(i_(- s )»7(i +s+ / t )» | h < Li < s + h] P(h < L\ < s + h) 
+-E*[7i*/(i+/j)»/(i+ s )»/(i+ s +/j)» | L\ > s + h\ P(Li > s + h) 

— Qi + Q 2 + Q 3 + Q 4 ■ 


We start with Q\. For L\ < s < h, I±* is independent of 

(I(i+h)*,I(i+s)*,I(i+s+h)*), given (X t ), but E*h* = 0 by (JEH) and therefore Qi = 0. Simi¬ 
larly, for h < Li < s + h, 7(i +s+ ^)* is independent of (/1*,/(i+h)*, /(i+ s )* ), given (Xt), and since 
-E*7(i +s+ / l ). = 0, Q 3 = 0. Each of the values i = 1,... ,n has the same chance to be chosen by the 
bootstrap, i.e., P*(7* = E) = n _1 for i = 1 ,..., n. Thus, for Li > s + h and the chosen i, the 
natural ordering ( 1 *, (1 + h)* , (1 + s)*, (1 + s + h)*) = (i,i + h,i + s,i + s + h) is preserved and 


2 


If indices in the sums below exceed the value n they are interpreted in the circular sense, i.e., mod n. 
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therefore 

n 

Q 4 — Tl ^ ^ ^ 5 -|- /i) 

i=1 
n 

= n- 1 Y Tih+sii+Ji+s+h (1 - oy+ h . 

2=1 

By a similar argument, m and using stationarity, we have 

Q 2 = £7*[7i.7 (1+a) . | s < Li < /i] £*[J ( i +fc) .7 (1+h+i) .] P(s <L X < h) 

n 2 

= n- 2 (^ ij l+s ) (1 - ey ((1 - ey - (1 - 0 )")). 

i =1 

Combining the above expressions and taking into account (18.61) . we arrive at (18.101) for s < h. 

We proceed with the case s > h. Then we have the corresponding decomposition 

E*[Il*I(l+h)*I(l+s)*I(l+s+h)*] 

= E*[Ii*I(i+h)*I(i+s)*I(i+s+h)* | L\ < h] P(L\ < h ) 

+E*[I 1 .I ( 1 +h) .I ll+a) .I ( i +s+h) . \ h < Li < s] P{h < Li < s) 

| s < Li < s + h] P(s < Li < s + h) 

+E*[I\*I(i+ h )*I(i+ s )*I(i+s+h)* | Li > s + h] P{Li > s + h) 

= Qi + Q' 2 + Q 3 + Q 4 ■ 

We observe that the left-hand side is symmetric in h, s and therefore the same arguments as above 
show that Q\ = Q ' 3 = 0, Q 4 = Q' A and 

Q'i = E*[I i.7(i +h) . | h < Li < s] E*[T {1+s) ,T (1+s+h) .} P(h < Li < 3 ) 

n 2 

= n ~ 2 ( E Vi+h) (! - d ) h ((! - e ) h - (! - 0 ) S ) 

i=i 

The case h = s can be considered as a degenerate case, where Q' 2 = 0. This completes the proof of 

doro . □ □ 

We conclude with a short discussion of the bias problem of the bootstrapped integrated peri- 
odogram mentioned in Remark 1221 

Lemma 28. Assume the conditions of Theorem^ 7] and the additional condition sup,j, en \iph(x)\ < 
c/h for h > 1 and a constant c. Then the following relation holds as n -7 00 , 

n — 1 

(—)°' 5 sup |v , o(A)(£*7a(0) — 7 a( 0)) + 2V V'fe(A) (E*j A (h) - (1 - 9) h j A (h))\ 
m A6n I 1 

(8.11) 4o. 

Proof. We observe that for h > 0, 

E*%(h) - {1 - e) h j A (h) = (l-d) h [(j A (h)+%(n-h))-i A (h)\ 

(8.12) = (1 - 6) h \y A {n - h) - m{p 0 -Inf] ■ 

For fixed h we have ( n/m) 0 5 m(po — In) 2 4 0 as n —> 00 and 

(n/?n)°' 5 £’| 7 A(n — h)\ < c ( m/n)°' 5 hpo —> 0 , n —> 00 . 
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Therefore it suffices to show that 

n—1 


lim limsupPf sup I V'' iph( A) (E*^* A (h) — (1 — 9) h ^ a(M > , S > 0 . 

k-KX n->no V A<=TT I . _ / 


n—>• OO V AGII 




Keeping in mind (18.121) . we have 


(n/m)°' 5 m(po — I n ) 2 sup I M VVi(A)(l - = Op(l/(6^rnn)) = o P (l) 

Aen ft=fc+i 

where we used 0 2 n/m —>• oo, and 

n—1 

(n/m ) 0 - 5 sup I ^ 


agii 1 


h=/e+1 


n—/c— 1 


< (n/m ) 0-5 sup ^ ^n-/i(A) (1 - 6) n h [yA{h) - m(l - h/n)(ph - pi)] 


xeu 


h =1 

n—fc—1 


+ (n/m ) 0 5 sup ^ ijj n -h(X) (1 - 0)” /l m(l - h/n)(p h - pi) 


Aen 


h =1 


= U + ^2 ■ 

Under the assumption sup xen \ tph(x)\ < c/A uniformly for h > 1, we have for small e > 0, 


I2 < (ro/n)°' 5 c^ ^ —> 0 , n —>■ 00. 


fc=i 


Now we can adapt the proof of Lemma [23] to prove that 

This proves (18.111) . 


lim lim sup P(Ii > S) = 0 , <5 > 0 . 

k ~IOO n—>-00 

□ 


□ 


However, under the assumptions of Theorem ll51 it is in general not possible to replace the quanti¬ 
ties (1 — 9) h j A (h) in (18.111) by ^ A (h), i.e., in general we do not have the relation (n/m)°- 5 (E*J* A — 
P 

Jii,a) —> 0 . Indeed, taking into account (18.111) and assuming 77 -dependence for (X t ), we have 
E^y A (h) = 0 for h > 77 and 

(n/m)°- 5 (E*J^ A -J n , A ) 

n—1 

= 2 (n/m ) 0 - 5 MX) [(1 - 0) h - lft A (h) + o P { 1 ) 

h=l 

n—1 

= 2(n/m) 0 5 Y MX) [(1 - M ~ 1 ] (M h ) ~ E 1 aM) 

h=1 
V 

+ 2 (n/m)°- 5 y^^(A) [(1 - 6) h - 1](1 - h/n)m(p h -pi) +op(l). 
h=1 

An argument similar to the proof of Theorem [15] shows that the first term on the right-hand side is 
stochastically bounded, while the second term may diverge (for example, if 7 a{v) > 0 and ^ ^ 0 ) 
since it is of the order 9(n/m) 05 which converges to infinity in view of the assumption 9 2 n/m —> 00 
which is vital for the proof of the consistency of the stationary bootstrap. 
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